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PREFACE 



The Planning Committee for the Fourth National Institutional Research 
Forum determined in its initial meeting that some of the basic issues in t e ^ 
area of institutional research should be presented and discussed at the Forum. 
These basic issues were broadly structured in the presented form so that in- 
stitutional research as a discipline could be subjected to careful analysis. 

The Forum itself was structured to provide a series of general seminars 
each of which was related to a common area of concern ai^ followed by a spe- 
cial seminar where questions and discussion were held. Thus the continu y 
of presented papers and the freedom of discussion were combined for each 

area of concern. 

The presentation of papers follows the sequence given in the program of 
the Forum. The reader should glance through the program to familiarize 
himself with this sequence and to more fully comprehend the continuity of the 

papers. 

The publication of the proceedings of this conference on institutional 
research is limited to those papers presented during the general _seminars 
The participation of the audience in these general seminar s and the subseq 
discussion by the participants of the Forum during the special seminars cannot 
be hoted in tLse ^ges. but their value and contribution to the Forum were sig- 
'nificant. 

of these proceedings will c^ntrij^^^ 

an under standing of institutional research as a multi -disciplineapdt^is^ 
icLtioiiale in pla;nning and evaluation in the educational., sphere. ■ On^ehalf of ^ 
the :Piiinimng Committee, I wish to thank the author s for r eleasing their papers 
of the Forum sessions for publication. 



Clarence H. 
Editor 



B ag l ey 
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PART I 

A CONCEPTUAL FRAMEWORK FOR INSTITUTIONAL RESEARCH: 

THREE POINTS OF VIEW 

Presented by 

Samuel Baskin 

Director of Program Development and Research 

in Education 
Antioch College 

Stuart Grout 

Director of Academic Services 
Boston University 

Robert E. Hubbard 
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Samuel Baskin 
Antioch College 



My comments will be quite brief and are simply designed to express a 
point of view about the role the institutional research service should play m the 
total college or university setting. I've organized my comments under the 
title; The Educational Researcher; Change Agent or Safety Man? The title is 
in and of itself tell-tale. 

Several years ago in an article in the Phi Delta Kappan , Phil Coombs, 
then executive secretary of the Fund for the Advancement of Eduction, asked; 

''What would happenuf . every ins titutioh; of ;hig her learning had 

an able top official in charge of research and development, a vice- 
president in charge of heresy?. ..... His job would be to welcome ^ 
fresh ideas, to encourage the trying out of new app:rpaphes, to eval- 
uate the results, and to pass these on, good and bad alike, to 
colleages in his own and other settings. " 

My thesis today is that educational and/or institutional researchers- -and 
I intend to use the designations interchangeably- -need to be taking a far more 
active role in the innovation and exploration of new program ideas in higher 
education. The rationale behind my argument is that higher education has for 
too long allowed itself to be caught up in its own straight-jacket of traditions 
and customs in teaching arid learning. Despite recent developments in higher 
education, the change agent is still badly needed. My suggestion is that 

the educational researcher assume this role and give it top priority in the 
running of his shop. 

Something has been missing for fcir too long, which I suspect relates to 
our own unwillingness to examine our as sumptions about teaching and learning, 
and to our unreadine s s to ask ourselves some questions about how we go about 
the educational process. Sorrie one needs to take hold. . Why not the educational 
researcher? 

I am not, of course, suggesting that institutional researchers drop every- 
thing and begin now to turn their attentiori' to a rnassiv^^ study of the college drop- 
out. I am, - however, suggesting that we have for too long been seen as the 
institutions' data collection and statistical analysis service. It's time we got 
into the college classroom a great deal more than" has been the case. 

I would argue then for a framework for research which defines the job of 

the educational researcher iti the following order; 

(1) The researcher must take the initiative and responsibility in encourag- 
ing experimentation and research in new ways of teaching and learning. He 
must serve as the rnotivating force, or what will be at times the unwelcome 
pr odder, in pre s sing the establishm«^nt for e xam ining wha t the unive rs ity does 
and how it goes about its busiriess.^A 

What about the ways by which we have organized for teachipg and learning? 
What kinds of experiences should, the student have in learning- -how rriuch teacher 
aid, how much classroom activity, and how, rnuch learning on one/ s own? What 
about peer-grouii ari''d'6th^^^ rion-.classroom W in learning? Who teaches 

O hat, and how does learning really happeri? 
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(2) The office should have both a research and assessment function, It | 

is not enough, of course, to suggest that the educational, research office regard ^ 

its central function to be encoxiraging educational experimentation, and to let | 

it go a.t that. We must do more than simply stir up the trouble, for with the ] 

experimentation must come adequate plans for evaluation and assessmeat. It : 

is most important that someone other than the initiator of the idea .br. the | 

experimentor do the evaluation. ^ 

(3) The educational research office must, of course, continue to 

^erve as a : significant arm of the college in long- range planning and projec- \ 

tions. The budgetary analyses, enrollment proj ections, space utilization, and \ 

class-size studies cannot and should not be shoved elsewhere. However, these 
activities should not dominate as the major, if not sole, function of the research 
office. 

It is, of course, easy enough to propose revolution and then to pack one’s 
bags and go home. ^ Before I^ pack my bags, I should at least offer a few 
suggestions as to *how one can make some inroads and begin to effect change, 
if not cause the revolution itself. I draw here largely from our own experiences 
at Antioch. 

(1) Establish faculty project grants. The faculty project grant can serve 
a most useful! function in ta.pping faculty creativity and in opening up ideas. 

Several years ago we announced that we were putting a small sum into the office 
budget for faculty projects and research. This was to be a strictly no-red-tape 
operation. We simply put a note in Faculty Notes announcing that the funds 
were available apd were designed: to encourage faculty rneinbers to develop any 
project or idea that they perhaps had Tong wanted to try out but had simply 
never gotten around to doing. We would reirnburse faculty for a week’s salary 
(although we knew well that most faculty members would prpbably^w up 
spending several wiseks, if not months, on the p r pj e c t ) and p r oy ide seer eta rial 
and clerical as sistence : whe re ne eded. In the fir the^ announce 

the project monies, . we had thirty; faculty mem 

(pi" id^ as ;r ahging from small- ale try - 6 lit s tudie s in which tliey expe rm 

-with their ow n te aching . rhethods to mo re e labor a te apropos als re la ting to c olle g e 

course offerings and new program ideas, including in one cat^ e a pr p 

the es tablishment of a new experimental ciollege wit^ pur owrn expe rime ntal 

college. . ' . , , 

(2) Try bringing in the consultant. No man is ah expert in his^pwn hom^ 
but bring in the outside con's ultant, arid by and large the faculty will listen. 

There is much happening all around us in new methods of teaching a pd learning, 
in the us e of the new media and te chiiblogy, in the us e of inde p e ndp n.t study , etc . 
Faculties, let along ourselves, need to be kept abreast of v/hat’s happening. 

The outside expert serves as one way of doing this . 

(3) Get out a memo to th e f a c ul ty ne w s 1 e tte; r , builletin, or what have you, 

but find s ome way of suirimarizing- «and I mean summarizing- - son of the _ ^ 

developnients that are occurring on the higher educational s.cepe. , -N 

time to read these days, . even in his own field. The quicbk suiii^ of deyelop- 
mehts, is sued‘ at regular intervals' can do a great deal in keeping fpcuj.ti^ 
their toes and open to ideas. / 

( 4 ) Try tlie faculty workshop' idea. Get a group 6f:faculty together simply ^ 
to talk about what they do in the ir cours e s ^and; clas s roopis , the objectives they , 






- and how they try to achieve these [objectives. J.t"is amazing now j 
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know about what the next guy does and how ready most faculties are, given the 
proper climate for give-and-take exchange, to seek help and learn from each 

othe r . 



This, then, is a plea for a new image for the institutional and educational 
researcher. It is a plea that we assume more of the initiative for innovation 
and experimentation in higher education. It is a plea that we put ou:^rnoney 
where it really counts --on the teaching and learning firing Iine--or better 
still, on furthering the education of the student. 



1 ' 
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1. What kmds o£ contributions can your studies make to the solution o£ 
the particular administrative problem or problems at hand? 

2. I£ he is given an administrative problem or problems, what kinds o£ 
studies make,use£ul conttibutions to sound solutions ? 

The: ins titutional re search d££icer is a creature pf a.diiiinistration and 
responsible to it. His e££ectiveness as an institutional researcher is directly 
related to the administrative- environment £ound in the institution in which he is 
emplo^ed^ Although he may sh^ 

influence decisions^ •. hut is not avdecisioh-makerv- ' Hi^ e££e s is related 

directly to the extent to which the administration is research minded and sees 
the value o£ institutional res ea.rch - as an a^^ process . 
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A conceptual framework for institutional research probably sho^d begin .. 

with an answer to this question: Why do institutions ';"^V'f„‘stin.°t^^^ 

search? Perhaps the simplest and most, direct response is that institutions ex 
pect insitutional research to provide data which will improve the ijr 

Put another way, if institutional research doesn t somehow contribute to im ^ 

proved operations of the university (and I us e the_ term ftdn ^ 

sense to mean any institution of higher education), , we probably oug ^ ^ 

spending increasing amounts of money for the support of ips i u lona „ 

offices and instead direct this money; to other purpo^^ 

salaries. I suspect many faculty members would judge ^hls^ to be a good x^ea. 

but since I enjoy institutional research; work and sincer^^^ this_ 

field are having some positive and measurable impact on higher education, I 

don't suggest such action at the present time. 

Just how does or can institutional research improve univers ity operations ? 

For one thing, we in institutional research can and should be cpncerned Tyith 

the directions our institutions ought to be taking. The fact is,, ho'wever,^ t a 
most of us are not concerned with university goals or purposes. We devote . 

much time to sEIdying what our ins titutions ^ domg, but w 

pr e c ious little energy s tiidy ing ivha t dir e c tio ns q ur ina titutio n s ought to _ ^ 
Lkine. I do not suggest that institutional resea.rch offices should rn^a^p 

Pdo^uggest that institutional research can play; a vital role in:_^ stu i 

on problems and issues relative to uhiy^^ Such -studies- qan bo . 

historical, descriptive, or projective, . but regardless of type, the. research . 
results should provide the objective data needed for the establishment of .... 
changes in long-range goals of the university. 

This is thb firs t requirement in my conceptual framework for institutional 
research: that institutional research must be involved in. studies of university 

' purposes --what they are, how they came to-be, and what, they qqght to be. i 

stress again that I do not belieye universities have in any significant .way ex- 
ploited the potential;;of: institutional rgs;earch'-Qffices ;for longr^angq; planning, c 
■ studies . W.eVin institutional^resear'cli have; not; Yfo.i^;;,exainpl^ 

cant efforts, to studying the impact of tlie;^epgraph>,c setting of :our. institution . . 
on our program pfferings . We haye -hot :analyzed. parefid^^^^ 

program duplication between our universities and. our neighboring ins i u 
as far as institutional pvirposes are concerned. . I win cite examples of such 
ne ©ded research later V in tbis state ixient. ( 

A second requirement in my conceptual framework is that institutional 

research should demonstrate, through research, how universities can be organ- 
ized most effectively to achieve long-range goals. We should, for exam 

help to identify the kind of financial support needed fqr programs which our 
institutions ought to be offering becaus e qf their unique geqgrap ^ic, ^socio^ 

economic, or cultural settings. I %lso have ;S9me e^m^^^^ 

research which I will describe laterr^^^ v v^ 

The third requirement in my conceptual' framework-for institutiopal 
research. is that institutional research must be actively engageci in studies- 
concerning the effectivoness. of university-prog and operationsv-agaip 

presupposing a clear statement of purposes. This,, of course, is. the -evaluation 
aspect, of institutional research and is .^e;;traditional role of institutional 
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research with which most of us are familiar. It includes cost studies, faculty 
load studies, class size analyses, salary studies, studies of students --their 
reasons for attending a university, the problems they face while there, what 
they tcike with tthem from the four or more years of exposure to higher educa- 
tion, what difference it makes in their lives, studies of the quality of educa- 
tional programs, etc. More about this aspect of institutional research 
shortly. 

Let me put this proposed cpnceptuar framework into context wiUi refer- 
ence to the setting I know best- -Wayne State University. Wayne is located in 
the heart of the City of Detroit and has the typical commuting student body 
associated with an urban-located university. We are somewhat unique in that | 

we are a state university, even though we provide great service to the metro- | 

politan area of which we are a part. We have a very strong public institution | 

as a neighbor--the University of Michigan- -whose sphere of service is consid- J 

erably larger geographically than Wayne's. Other nearby schools include the ? 

University of Detroit (privately supported) and a nunib^ private and j 

public institutions ranging from community college s to four-year branches of [ 

other state universities, plus extension prog raims of several kinds. Among ■ 

Wayne's strongest colleges are the School of Medicine and the College of 

Education, both of whose origins date back nearly 100 years. We are today a 

federation of profdssibrial and general schools loosely tied together^ we 

have an em,e rgihg graduate' prbgrain now constituting on a head count basis 
nearly one -third of our total student body of 22, 000. 

Det' s. examine first the possible role of institutional research in the 

es tablishrnent or ^modifi cation. pf ;uniy®^. si ty:d^ ; 

is an idealized conceptual franaework with reference to Wayne, for we do not- 

yet conduct "many- of 'i^the studie s which D shall 'cite by way of illustration. ,, 

We should start with consideration of the three broad areas of service ' 
traditionally as so'ciated with £ American uni ye rsitie s - - the functipris of instyqq^ 
research, and public service. Wayne's Institutipnal Researph Office: s^^ 
conduct on-going studies aimed at 'd.etermim contributions -whic^ . 

Wayne StatessUniver sity •‘can“make;:'tbfehighe rieducatio'n'^in "M^ph^S^h: tb?‘bu-gb 
of these three' service areas. With reference to instruction, wevmust study / 
not only the educational programs now provide'd' by Wayne tb t^e City of Detroit, 
but also those programs' which should pfesu^ablybbbf^ 

the metropplitan area spreads farther; and, farther. from the core of the city. 

We should s tudy- the actual and potehtiial irinpact oh ; Unive r sity purpose of student 

reasbhs for attending Wayne, and we vshould exarnine; the changing rnetroj>plitan 
population to hyelp shape decisions affecting long-range plans. We should help 

to identify program duplication with biir neighboring institutions in order to 
direct financial resources to areas where the heed is greatest. ’ 
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These proposed area<^s of investigation. are especially rGlated tp the inn 
structional responsibility of Wa'yne, butjthey have vimplications as well for our 
research and public seryice a.fms;^- W^^^ researph, for; e^mple, 

institutional research can, by way of surveys, help to assess - the 
university to contribqte through re search, to local businesses and industriesV 

Consider next the role oT institutional research in identify^,ipg hpw pro- r.. 
grams or . program and. operational changes needpd to achieve university pur- 
poses. Given one purpose:- -the need.fpr close m'etroppUtan.pp'mmunity-- 
iiiTiive rsity inte ractibn,- • we -in , institutionalSire searph ;shpiJ.ld study .the , kinds of 
- —rmal and informal education arid .related: progreTms y/hi'ch .willibest' prbmbte 
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such interaction. Our investigations should consider such questions^as the 
following one: What are the places of social work, urban planning. 

tional municipal government employees, and other community-related programs 
in a university committed to close community -university i.nteraction . 

We should identify the potential "market" for such programs, and we 
should help to anticipate changes for specified years 

we should help to project the cost of continuing or strengthening programs of 
this kind in the years ahead. - " ' 

The third element in my institutional conceptual framework is study of 
existing programs and operations to determine their 

buting to university purposes. This, it seems to me, IS where in , 

research has made its greatest advances to date, and it is ^certainly ° ^ 

Wayne. We are developing quite sophisticated techniques j.or as sess > g 

costs of University operation, for analyzing class size, f^^^ 

patterns in different Univer sity units, and for compiling factual data on fa y 

characteristics. These still are largely quantitative studies, to ^be sure. _ but 

they represent some significant advances for us. and are presently or will soon 

be providing a great deal of potentially useful information for decisiqn-making 
purposes. We must continue to carry forward objective studies of current 

programs and operations, hopefully extending these to include more of the less 

tangible and more qualitative e vide hce s of e ffe ctivene s s . I : be liey e. h(^qve r. 
that mo re of our energies must; be directed to the first two area^ - - studies of 
Univers ity purposes and studies of the kinds of programs needed to achieve 
these goals. , . , 

In considering how I would de'velop my conceptual.framework-for this 

presentation. I first considered and then excluded. from immediate consider- 
ation certairifaclfors which tfelt helped vtq^ research , 

can be most productive. I still believe? these : are peripheral tcy a conceptiou of 
insatutionar research, but si nee I also believe an awareness of thear impo^^^^^ 
can help to maximize the. effectiveness of institutional research, I -want to cite 

them here: • ; . • , ' 

1. First, the most effective kind of institutional research is that -which 

is cpriduc ted or repeated ove r an , extended ; period of time. Not only .. 
is the research itself perfected' through repetition, but also extremely 
valuable trend data will b)ecome; app3-:l'®Pi ip 

2. Some of the rnost positive benefits of institutional re^par^^^ 
benefits, i. e. , those which occur as a result of the presence^qf insti- 
tutional research but which were not necessarily the intent of the re- 
search. I have particularly in mind the sharpening of definitions by 
other university units and the awareness by other units (both educa- 
tional and service) of the need for greater consistency in the data they 
gather and maintain. 

3. Institutional research will not have real vn pa c t; o n r uniy^ r s ity o p e r a 
tions unless specific steps are taken to ensure that.the results of re- 
search are conveyed to those with key decisio.n-rnaking responsibility.^ 

We at Wayne haye'^attempted'to prbmqte communication of institutiona-i 

research results tiirough a we, ,ekly "Trend;Sheet'' published;, as a^ staff 

briefing paper for -central universit-y; administfatidn. Results of . 

institutional research conducted by my office and by other agencies 
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on and off- campus are digested and reported in succinct tables and 
text in this publication. 



4. 



Because of an ever-increasing need to bring together more data from 
widely varying sources, some kind of storage and retrieval system 
is needed. We at Wayne have tried to solve this pr obldm through the 

establishment of an administrative reference library, a highly spe-i 
cialized reference resource for the use of key administrative 
personnel in the university. 



This then is my conceptual framework for institutional research. It stems 
froin the premise that institutional research exists solely to improve institu- 
tiona.1 operations, and it rests on the;; conviction that to be really effective in 

achieving this end, institutional research rnust concern itiself with three types 

■'of studies: ■■ ,; ■•■■ 



Those studies which relate to the establishment and. i- 
modification 6f ins titutiohal goals. ^ 



2. Those studies which reveal the ways an institution should organize to 

achieve these goals. 



3. 



Those s tudie s which evaluate thei eff ec tivehe s s of current programs 
and operations of the ihstitutich. \ 



It seems to me that we in institutional research have made our greatest 
strides in the studies we are doing on existing vinstitutional prpgya^s^^ a 
op e ratio ns . I b e lie v e dur r c hall e ng e ; now- i s to c a r ry f p r wa r d s pm e re ally 
effective studies on long-range institutional purposes and on the programs that 

institutions need to d stablish- to achieve these goals : ^ . 
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PART II 

THE ROLE OF iNSIITUTIONAL ^ESBRCH 
IN the FORMOIATION OF POlJCT 

Presented by 

Eldridge Scales 

Associate in Higher Educational I^searph^ 

New York State Department of Education 

Vernon Hendrix 

Assistant professor of Education 

University of California at Los Angeles / 

Lois T orrence 

Director of Office of Institut 
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Eldridge Scales 

New York State Department of Education 



An Historical View 

Educational research as a specialized function of the State Education 

Department had its beginning in 1920 when the position of "Specialist in Educa- 
tional Measurement" wyas created. The Bureau of Educational Measurement 
was organized in 1923 and became the Division of Educational Research in _ 
1929. In 1937 an Assistant Commissioner for Research was appointed, and the 
Bureau of Statistical Services was organized. There was little increase in 
staff size from that time until 1942 when the first lump sum for research was 
appropriated by the legislature. 

In the fall of 1956 an over-all reassessment of staff and function of the 

research-related offices was made. In accordance with this reappraisal, a 

reorganization of the Bureau of Statistical Services was formulated. 

In the early years of the Division of Research, emphasis was placed ppon 
administering standardized tests in the schools of the state. GTadually, the 
emphasis shifted to working upon a broader range of research problems. A 
the present time, matters of administrative research related to public elemen- 
tary and secondary education have become the core of this Division s work. I 
is still to this Division, however, that the Department looks for exploration 
and description of new areas of concern. 

In 1956, also, the Quality Measurement Project was conceived. In recent 
months this section has become an integral part of the Exper^ental 
Section. This section is responsible for encouraging and, administering a Pro- 
gram of experimental studies of practices in public schools and school systems 

.‘ in. the state. "• • -;'V. 

In 1957- special funds for research related to fiscal policy were transfers 
red to the res earch office s . A special section,- structurally sirnil^r to ^e 
Quality Measurement Project, was created--the Bureau 0/ Educational Finance. 
Research. ' - 

In 1957 i:he Division of Research in Higher Education was organized. The 

formation of tHis new divisionireflected further broad cognizance of the State 

Education Department's leadership responsibilities. in this area.' 

The following diagram indicates the general organization of research, the 
interrelationships within the research offices, and the Division of Research in 
Higher Education in detail. 
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On May 4, 1964, a memorandum setting forth the reorganization of the 

research offices was received# The. reorggiii^ation: diagrarni^ 
figure may be contrasted with the old organizatiori as seen atiove- 
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Special Functions 

The functions of the Division in Higher Education are classified as 
follows: 



1. To maintain a continuous, statewide record of recurrent, factual data 
regarding the operations of colleges of the state so that reliable information 
may be available as to accomplishments, progress, and needs of the state 
educational system and its component institutions and universities. 

2. To explore and analyze extensive and complex educational issues of 

departmentwide significance for the purpose of discovering, verifying, . 

interpreting theoretical principles, new facts, and new techniques and methods, 
upon which the state educational authorities can plan future policies and ^ - 

programs. 

3. To marshall pertinent data relating to those uruiiediate problems of 

maintaining standards, effecting economies, and inqproving educational 

practices arising froixi the operations of the Departnncn.t< 

4. To obtain and report essential information on broad educational, ^ 
social, economic, and scientific trends and developments having far-reaching 
implications for higher education, with the view tof identifying the needs for 
modification of existing programs and practices, and anticipating incipient 
problems in higher education of the state* 

5. To encourage and assist in the educational research. in the Department 
and in the field, and to cooperate with other units of the Department and with 
colleges and universities in carrying out research studies and projects. 



The Nature of Resea rch in the Division , of Res ear ch viri, Higher Education 



are 



The research services: required in the State . .. 

wide in scope, covering.all of the activities and, int:eres^^^ department. 

In general, projects carried out by the Divis ip ncxDf .Research ih^H 

Education may fall into several realms: r ' 



( 1 ) 



O 
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Evaluation. This research is directed. toward ongoing programs ^ 
sponsored or supported (1) by and/or within the Department, or (2) 

administered by colleges and- universities in the j'state; but suppor 

by State funds. Illustrative of evaluation studies are ;the.^series of 
evaluation studies of in-service programs designed for teachers in 
mathematics and science, foreign language s , and computer mathe- 
matic s ; the evaluation of s electe.d as pects of the program of g i^ants 
for teachers of the mentally handicapped. At, present a study of the 
college teaching fellowship program ia underway. 



( 2 ) 



Applied research. This re s earch is dir ected toward ^ practical 

problems; the results.most often are applied toward 'pcDU determi- 
nation. This type of 'res earch isigenerally the type, most frequently 
conducted. AfStudy^ representative of this type' of .research is; The 
Cooperative Study oTTeacher'Educatiop in Eiberal-Arts Colleges. 
This, study was a c66peratiy^'\eff^^ 

p r iva te, libe r al a r t s . c oile g e , This;' lo ng itudiqaE s tu4y of ‘ libe ral aits 

seniors and{ gradtiaCtfe s rwho'-'eniier w'as ^cle'' s igjxed to provide ‘ 
1 — or' methods ■ 



a factual basis fpr change in prpi 
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^■p rateeorv was that of tuition in City 

Another =t“dy illustrative of this provide factual infor- 

University of New York. regarding the effects to the University 

mation for the to students at varying socio-economic 

L^?lS ’^'lt^l“o“:uglT?o a^^^rmin the impact on the state of a fixed tuition 

policy at the University. ^ 

(3) Basic research. B^‘'"J“nSi1hon“of‘*Reie^^^ inNiJher Education 
Ss%\f*':/?n coop-aSn*^^^ an institution of higher education in the 

state. 

A prime example of this -“8ory th^ 
two- and four-year college students in 26 higher institutions in 

senior (four-year ))college and . the division of Research m 

fo^r states. It is a <=-P--‘-:4*“s‘SiTducSiot^ and the Office of 

r^f^m^fo^n^rrsea^crof^^^^^ University of New York. 

These projects of ®Yaluation and^pgied^ Projects of 

be instituted by a request for ^ith the Division of Research 

basic research will be ^ “^ably basic research represents the interests 

in Higher Education Itself. Inevitably, oasx 

of the researchers. 

. n 1- ,q^ff,aTcsntiated from institutional research in the 

Research at this level is differentia sienificant Avays. First,- r 

individual college or univer^^^>^obgl2^ ^g ^^^.^^^^^ 

search is conducted tq^provide the fbrmvilation of policy, for 

basis for policy formulation and decisio ^ of colleges and universities. 

leadership in a sin^e 1 sliu^q ^ a.re 202 private: andRublic colleges an _ ^ 

Division of Research in Higher Education. V / ; 

In summary. (1) ^ . 

pertinent to sound policy formal ^ r YorkV and its component units, and 

diversity system .(Smte research with assigned 

i^arinm«s diStmgutshmg 

features. V V V, ‘ 

Thus by its organizational ^ture awl functio^l^ 

higher education is recognized as yp^.dial a . . ^ policies 

^..‘"u^w rrincipl-^ educational 
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services and administration, they also give meaning and orientation to the 
forward-looking leadership role of the Department. 

The responsibility of research and statistical services is notably differ- 
ent from that of operating units in the Department. Research is essennally a 
staff function. The results of research activities and inyestigations help the 
Regents, the of Education, and his c^leaguea in the performance 

of their policy-forming and administrative duties. Tjie^results of resea^ 
similarly, should be of value to the administrators of the separate institutions 

that collectively form the universities of the State of New York. 

Intrinsically, the nature' of the services thus provided is informational 

and advisory, as contrasted with supervisory or administrative services. _ 

Consequently, making administrative decisions and implementing poliqie^ 

nrogr;Sns are outside the domain of research an d remain the responsibiliti^ 

of the operating units . 

Research can indicate possible courses or opportunities, ass ess 

probable results of decisions, test the facts assumed in the making of decisions, 
and clarify problem definitions. AH this should be helpful; to administrative 
decision anl pplicy-m^^^^ but it is not to be Confused with such operational 

responsibility. ; , 

Since research serves operation, there is need for clp^ ^jking rela^^ 

between research personnel and line administrative personnel. There is a 
need for clear channels of two-way consultation and repprting among ail 

. . involved;-' '-'“V- ■ 
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instructors on the first day of classes with class rolls which ' .. 
contain complete student test and achievement records. 
structor tests are scored and completely item-analyzed within 
24 hours. All types of cumulative records are maintained by 
class such as grades, probability of student success in later 
classes and after transfer, etc.) 

8. Only 30 (9 per cent) havS separate budget items for institutional 
research. 



I 



i 
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9. The studies submitted for analysis were found to distribute 

themselves approximately into the following clas ses^ (following 
Brumbaugh’s classifications); student data (prediction, follow- 
up, drop-out, etc. ) comprised 20 per cent each; all other 
studies, such as admission and enrollment, administration 
and organization, finance, goals or objectives, plant, and 
public relations constituted 10 per cent of the studies. 

Several problems or needs are readily apparent: 

1. Institutional res earch- personnel need training in research 
design, measurement, etc. The many poorly designed and 
executed studies bear witness to this. 

2. An ''institutional research atrnosphere'' must be established, 

so that as marly of the staff a. s possible are interested and 
will participate in institutional research. One president 

underlined this by statiiag: ''YQn^ inspired teaching 

without intellectual or scholarly curiosity. " Another presi- 
ent said: "Junior colleges claim excellent teaching without 
research to prove it. 

3. More inter- institutional cooperation and sharing must be 
achieved. For the past thr 9 e yea 

research personnel from about 30 junior colleges in Southern 

California has beeffimeeting twice each year to d,is cuss and 

share information.^^^^^.^T^^^^^^^^^^^^^^^^^^^^^^^^ 

ship Program at U. C, L. A. , in cooperation with this group, 
held a ;bne-day cbh^^ 75 people representing 

28 colleges. We hope to make this an annual offer. Recently, 

some northern California junipr, colleges have^^b^ 
ested, and there is talk of forming a s 

research group in cbnjunctibn with the California Junior 
College Association. 

In general, progress has been mads, and the need for more and better 
institutional research is acutely felt. 



To illustrate what institutional research is being done by one California 
junior college, I would like fh suinnparize fi^bin the, annual report of ^^o 
research office. More extensive institutiohal research programs could be 
found in other California colleges , but. this was- selected as typical of the 
larger colleges. ■ ■ 




• ihanyi ways but 
" or informal. 
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^ade on the ca^pun or any 

and°enc?mpaLe^ all fci^ntific studies from those which might be 
called ‘basic research* (such as experimental study 
methods of teaching a certain class) to the suti^anzing 
tical data which might be used in making wise decisions and in 
developing policies . ** 

The research office of this Junior college has many functions which can be 
of value to faculty and staff members. Such functions include. 



1 . 



Serving as a library of research materials, i. e. , study reports, 
data, and historical materials about the college; study re por s 
on many subjects; books; periodicals; etc. 

"Your help [ this being addressed to the faculty ] IS _ 

urgently requested in the collection of such.^ 

that can be catalogued and readily used by mo|e 

people. If you have class or degree projects that you 

have done concerning the college, Study reports of . 
historical value, or other materials relating to 

possible institutional research that you coi;ne across 
in your reading and contracts, we would certainly , 

appreciate receiving copies, or hearing about them. 

Responding to questionnaires, of which tiie re atre hi^reds ^ 
throughout the year. Many questionnaires are coordinated and 

answered by this office, which saves the time of other profes- 
sional people. Questionnaires can be much more easily an- 
swered if a broad basis of information can be developed. 

Assisting in conducting studies for the college. Insmution^^^^^^^ 
re s earch is a^ rnatter'of teamwork by^m^ i . 

studies will bb initiated arid/ or, accomplished by 

others by small "ad hoc" committees; still others by larger, 
long-term committees; and some by outside consultants. In 

this process the research office can function in a variety of 

ways such as: ' ^ 

a. Serving on study Comaxiit.tees: :in d:l^^ 

xriember, chairman, secretary, consultant. 

b. As sis ting other individual s ^ s tudie s by helping to 

dcsigri, collect data,- duplicate reports. 



4 . 



c. Assisting with follow-up Studies. 

d. Providing some secretarial/ clejrical help. 

Conducting some studies of the type that will provide statistical 
information to answer such questions as; What are other junior 
colleges doing in honors programs ? How do other junior 
colleges deal with parking problems ? 
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5. Coordinating institutional researchyit the college by: 

a- Maintaining a master list/and file copies of what has 
been done. These could include departmental studies, 
student projects reports, graduate term papers, and 
master or doctoral theses. 

b- Obtaining copies of reports for research files and 
dissemination. 

6. Helping disseminate research information and recognizing 
effort in the field. 

This college maintains three files which are brought up to date annually. 
They are as follows: 

a. A master list of institutional research at the college. Thirty- 
four studies were completed in 1962; twenty-eight were completed 
in 1963; and fifty-two have been completed or are in the progress 
this year. 

b. Continuing institutional i;eports in areas that are maintained at 
periodic intervals, sucli as grade surveys, testing summaries, 
various administrative tests of students for honors lists, place- 
ment tests lists, room utilization surveys, enrollment compar- 
isons, placement reports, and probation statistics. 

c. List of projects currently in progress. 

In gjummary, this is not a; comprehensive report of institutional research 
in junior colleges, since sufficient data and length of experience are not avail- 
able. The first full-time institutional research officer in junior colleges, ex- 
cept for isolated examples such as Stephens^Gollege, 

last te n y ear s . ^/lo s t paper s and. publications about, ins titu^ r e soar ch in 

j unior colleges , such ias Stickle speech at the 196 1^^^^ c Ameri- 

can Association of Junior Colleges (the fir st such speech at an A, A. J. C. 
convention) and the 19,61 confer enc^.,at^^^^^ 

ments cohcer riihg purpos es,^ m organization, impleme^ ^*^4 

methods. -V The conference held at U. C* >1 A. this spring is, ta the be s;^ of our 
k howl edg e j th e fir s t to de al ■ : w i th s ub s fa n tiy e m a tt e r s and s p e c if i c s t udl e s . 

Thi s CO nf e r e nee may w ell r; e s ult i h the fo r m of a s tate wide j \ani or c bile go 

ins tituti o na 1 r e s e a r c h 6 r g a hi z a ti o n, p e r hap s , a n arm of th e C alifo J , unio r 

College Association, and a depository and- retrieval systern to facilitate the 
rapid sharing, ^pooling, and exchange of data among colleges. This would be 
assisted by an E. D. IP* system, likely housed at U« C. A. 

Concerning the use of institutional research in the formation of policy, 
only a few "examples might be cited. Stephens College is probably the most 
visible example. In most instances, junior colleges use institutional research 
to evaluate policy, meas u re ef f e c ti v e ness, a nd p r e di c t th ing s of cp nc e r n . s uch 
as student enrollxxients in various curricula, achieyem.entSp etc. T 
report will, it is. hoped, give some' idea of the s cope and depth of insl.itutional 
res ear ch in j unior Tcoliege s, the g r eat amount of inte r e st ; in s uch research, and 
the developments ahead. 
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L. E. Torrence 
The American University 



There are today several very effective regional, state-wide, and miscel- 
laneous cooperative ventures in institutional research. Such groups presume 
effective institutional research on the individual campus, and the results of 
cooperative studies are, in the last analysis (at least for private institutions), 
meaningful principally in the context of the indivi^dual institution. 

institutional research on the individual campus that I have been asked to direct 
my remarks this morning. 



Why does a college or university establish a special com;^ittee, office, 
or agency for institutional studies? Since specific 

institution. I can speak only for my own university. Several factor s^made such 
a move a logical one for us. Our student body had grown very rapidly 
past decade (from about 4, 000 to 9. 500 with 3, 800 of these full J:ime), we had 
decentralized administratively into six colleges and schools and a large non- 
degree division; data processing (begun in 1955 with the Registrar's office 
functions) had expanded into admissions, accounting, business^office^^^a^^^ 

other operations; and an IBM 1401 was to be in use by f^ll 1963. A^great deal 
of raw data were available, but largely untapped and seldom adequately inter- 
preted f(Tom a university-wide viewpoint. The necessity of effective coordma- 
tion and interpretation of information became obvious in the course of the ^o- 
year intensive work of a faculty self-evaluation committee preparatory the 
normal decennial visitation of the regional Middle States Association in the 
spring of 1963. Though perhaps overdue, the decision was rnade late 
to establish self-evaluation as a continuing function at the University and to 
focus the responsibility for certain'.phases of this process in an office o 
institutional studies, effective July 1, 1963. 
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No specific ground rules concerning the operation of the office were se 
out when the basic decision wa.s made. Instead, I was asked by the_pre^i en 

of the University to visit several colleges and universities tp; see _^hat they^^^^ 

were doing in this field. As a result, I yipited last spring some 12 institutions 
in New York, Pehnsylvanih, Ohio, ; and Michigan, ; and, in additiQn. atten 
the meeting of this gr oup at Wayne The collies wer^ selec^^ 

as varied T picture as possible-large, small, public, private, i^ban, 
some with highly developed programs of institutional studies ^ and some -vyith 
no formal structure for this purpose. 



For me the experience was excellent, and I would recommend such a 
venture to anyone in the field and, indeed, to those who hpye ^ 

for many years. Conferences such as this one are valuable in the exchange of 
ideas and experiences. However, the real feeling for the roie^or absence of a 
role for institutional studies is to be found on the campus itself. 



I received a wealth of advice--direct and indirect. Needless to say, I 
have not followed all of it— sometimes deliberately, sometii^is quite helpless y 

as for exaTAple, the cardinal rule advanced by one person— Don t let anyo 

iiripose- deadlines. '' I m.ust have a; serious talk with fhat gent epnan again. 

Anbtliertrec theme-- "Get adequate budget and staff r-is, I am sure, 

familiar to all of us. 



on the 



Did I acquire any over-all impres sion, of the role of institutional studies 
iadiy:^uai carnpu At the risk of overs irnplification, the. organizational 
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structure which I found could be divided in four general categories: 

1. In four of the 12 institutions no central program of institutional 
study existed, although in one instance the title was held by an 
administrative official with another position which required his 
full time. In the other three colleges there was no lack of inter- 
est in self-study, and several individual offices--registrar, 
dean of students, development office, etc. , — did conduct studies 
of a limited nature. In two instances moves toward coordination 
were under consideration. 



2. In one college the research was under the direction of a faculty 
committee, coming chiefly froip. the psychology and education 
departments. Graduate students were used to conciuct studies 
of student motivation, attitudes, etc. In this college there ^ 
appeared to be no working relationship between the institutional 
research office and the policy determining structure. 

3. Although an office of institutional research existed in two large 
ins titutione, several other offices also v/ere engaged in special 
phases of institutional study. There appeared to be fairly close 
cooperation between some of these offices, but duplication of 
effort was also evident. Reports seemed to be principally 
statistical in nature, and if analysis was a function of the office 
of institutional res ear chi this was not readily evident. 

4. In two universities the collection and analysis of data were 
clearly combined, arid, in additiori, the office of ins titutional 
research designed arid carried but research projects ori 
students, faculty, management, a.nd many other phases of the 
operation of higher education today. 



The validity of my impress ions- -and I s t r e s s the word im p r e s s io n s - - o n 
both the organization and bn the rble of the office ■ is, of cpuirsei limited by (a) 
the short period bf time involved iri . each visits and (b) _ 

conversations were for the mbs t part with individual 

s tudy. who naturally wp uld have s bme dbg re e bf : ve s ted intb res t in the ir po s itip n 
and its role on their campus'. In this context I wotild summa:rize^^ . 
impressions of the varied approaches to ins titutibnaf^ these term 

1 . Ins ti tutio nal s tudy i s not s olely de pe nde nt o n the c r ea tio n of a 
formal administrative unit for this purpose does the 

existence of such an office bn p»aper assume an operational unit. 

2i At j.east in larger colleges the coordinating influence of an office 
of institutional studies can be a major source of strength for 
both the university and the office itself. 



3. Offices engaged primarily in behavioural and theoretical research 
seemed to be reihovedfr bid th^ iiiaihstreaxri of university ope ra- 
tions and to have little influeucb in the on- going formulation and 
implementation. ' 



(I would add that in my opinion the use of the yvor d / *r e search'* in r eldtipn 
what the majority^^ vis are doing is misle We are engaged in 

dies, but seldom in actual research. ) 
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4. Offices which concentrated on the collection and collation of 
statistical data without interpretation and analysis obviously 
performed a useful function, but it is difficxilt to generalize 
on the role of such offices in policy formixlation. 

5. The offices which appeared to be the most effective were those 

which combined collection and analysis of data. with a close 
working relationship with the top academic officials of the 
university. ; 

6. Finally, the role of an office of institutional studies will 
differ as much as the institutions themselves vary and, more 

specifically, as much as the primary interest of the individuals 
responsible for the studies will vary. As directors of insti- 
tutional studies, the approaches of a statistician, a psychologist. 

a sociologist, or a scientist w^ill: inevitably be influenced by the 

discipline from which each is drawn. This is both a strength 
and a weakness--strength from infusion of new and valuable 
insights and techniques, but weakness from the viewpoint of 
continuity of operations and comparability of studies. 

What approach did we adopt at the American University, and what has been the 
experience of the office in these initial ntionths ? 

Administratively, the Office of Institutional Studies is responsible to the 

Vice President. The staff consists of a secretary assistant; ^nd myself. ^ ^ 
Cooperation from admissions, business office, and other adrhinistrative units 

has been very good, but the objective of full coordination of data and miximum 

utilization of the computer has not been achieved. 

In part this has been my own decision, In the initial process of deter- 
mining the most useful data and the kind of analysis needed, I found it ye ry 

valuable to w’ork directly with the available figures from the yarious source 

offices --r^^gistrar, admissions, accbunting, etc. I am convinced that any 
attempt to program the needs of the new office for the computer without having 
been immersed in .the relatively "raw" material compiled through the, earlier 
data processing equipment would have resulted in rhany .faulty; reports ^ 
costly trial and error. May I add hastily that I have no intention of prolonging 
this initial period. Our basic institutionaPstudy needs will be programmed, 
shortly for routine production, and we will be able to move into new areas for 

study. .. 

What types of studies have ;been carried out this year? Briefly, they 
include the following: 

^ a) Academic characteristics of entering freshmen (not new). 

b) Relationship between sources on CEEB Verbal and English 
Achievement and grades in English composition for the fall 
semester. 

c) Academic characteristics of tratisfer students with special 

reference to junior college graduates and performance of these 
students in the fall session. ^ - 

O 
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d) Preparation and analysis of a questionnaire distributed to all 
seniors and freshmen concerning their reaction to oar university 
requirements or general education program. (Initiated spring 
1963 under the direction of the Continuing Committee on Self- 
Evaluation. ) 

e) Academic characteristics of entering graduate students. 

f) A profile of the graduating seniors of last June- -in c lading 
entering qaalifications, date, transfer status, GRE, rank in 
graduating class major, etc. (not yet completed). 

gj Presentation- -graphic and oral““Of an "information" session 
for the University Senate on the changing nature of the student 
body between 1958 and 1963. The same material was later 
presented to the Development Committee on the Board -of 
Trustees. 

h) A wide-rangingtstudy of the cur ricvilum under the direction of 

an administratively appointed committee on curriculum problems. 



Have there been any results fromtiheTse studies? In terms of policy 
changes, only one action has been taken. As a result of the study of the per- 
formance of transfer students, the Admissions Committee recommended and 
the University Senate adopted a change in the degree of requirements for 
transfers from junior colleges. 

Following the information session on the changing nature r>f the student 
body, the Senate appointed committees on graduate students and on part- time 
students. Senate discussion of their finds will take place n.ext Wednesday. 

Over the past few months a large proportion of the work of the Office of 

Institutional Studies has been devoted to the curriculum study. Using the 
academic years 1958--59 and 1962-63 as base years for comparative purposes, 
we collected andiaha-lyzed information on a variety of matters related to the 
curriculum in its broadest sense. v 

The studies include for each depa.rtment and school (some 220 . .. .: . 

instructional units),:- ' : \ : v V ' ';'" -' 

a) number of courses offered. 

b) number of full-time and part-time faculty and full-time 

equivalent teaching faculty. 

c) the proportion and level of classes and credit hours taught 
by part-time faculty. 

d) student credit hours by status of the student and by levels 

of courses. 

e) number of majors, full itfiiiBB; and part time. 
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g) average class size--for each of three levels of courses and 
■ for ali.:cqursea. ■ r 
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h) number of courses with enrollments of less than 10, less than 
15, etc. 

i) composition of enrollments in our mixed levels- -graduate and 
undergraduate- -courses. 

j) average student credit hours for classes taught By full-time 
faculty, and by part-time facility. 

k) average yearly student credit hour production by full-time 
faculty. 

l) instructional salary costs --full time, part time, and total 
faculty--per student credit hour. 



m) total departmental costs per student credit hour. 



n) use of comprehensive examination fields by candidates for 
graduate degrees. 



o) courses taken by graduate students who received degrees in 
June 1963 . 



These studies served as the basis for a draft report on curriculum 
problems which has just been presented to the UnIversitirSenate. 
discussion the final report will be presented to the President and the Board ol 

Trustees. 



Apart from the collection of data, what has been the role ofJ:he office of 
institutional studies in the preparation of this report? I reaUze^ there is, 
among leaders in this field, substantial disagreement at this poinlv Jn the 
context of my own experience I must side with those^who believe that to be _ 
most useful for the university- -and, incidentally, most satisfying persona y- 

institutional study should include participa-tipn in poHcy recommei^atic^ ^^ ^ 

This was the case in our curriculum studyi and I found it^a rewarding p^ 

ence . Policy recommendations and the cLctual making of decisions are not, 
hbweve r . ide ntical. ■ One may participate ;in ;the^^ 

faculty status on the one hand and, through mem in a 

committee or other administrative couric^^^^ othe r hand. Ho;weve:r , ^ a ^ ^ 

office of ihstitutional; studies can u^urpynpither faculty nor final administ 

responsibility in the decision-making processes. 
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Implementation of policy normally will not be a direct responsibility of 
our Office of Institutional Studies. Probably the most significant^contribu^^ 
of my work at this point will be the providing of a constant flow of data for 
management analysis and planning, especially in academic areas which often 
are neglected in the cost-conscious orientation of our business^ office. The 
leavening effect of academically oriented studies to offset purely financial ones 
is essential today. The faculty will not be easily convinced tlmt ma^agem^ 

analysis of academic affairs is in any way in their interest. But today 
institutions of higher education- -especially private institutions- -facing 
ingly complex and multi-faceted problems, the laissez 
curriculum advanced by many faculty members must be modified. “ 
leadership in developing new pr inciples for acaaemic manageme nt and planning 
can emanate from those clearly dedicated to a;cademic concerns, then the 
faculty may be led- -though protesting, gi|JJ.east not screaming--invo t e 
realities of tomorrow. 
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In approaching this question of the role of institutional research in the 
implementation of policy, one must emphasize the concept of decision-making, 
and ask what decisions are involved in the process of policy i:^plementation. ^ 
What role, if any, should be played by institutional research in this process in 
an institution of higher education. 



I should therefore like to preface my remarks by quoting at some length 
from that classic in the field of the theory of organizational decision-making. 



Herbert Simon's Administrative Behavior. Speaking of the role of knowledge 



in rational decision-making, Simon writes; 
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"At each moment the behaving subject, or the organization 
composed of numbers of such individuals, is confronted with 
a large number of alternative behaviors, some of which are^ 
present in consciousness and some of which are not. Decision, 
or choice, as the term is used here, is the process by which 
one of these alternatives for each moment's behavior is selected 
to be carried out. The series of such decisions which determined 
behavior over some stretch of time may be called a strategy . 



"If any one of the possible strategies is chosen and followed out, 
certain consequences will result. The task of rational decision 



is to select that one of the strategies which is followed by the 
preferred set of consequences. It should be emphasized that 
all the consequences that follow from the chosen strategy are 
■reievant to the evaluation of its correctness, not simply those 
consequences that were anticipated. 



'VThe function of knowledge : in the decision-making process is to 
determine which.of the alternative strategies. It is the task of 
knowledge to select from the whole class of pos sible consequences 
a more limited subclass, or even (ideally) a single set of 
consequences correlated with each strategy. 



. . in order to perform with perfect rationality in this scheme, 

(man) would have to. have a complete description of the cons eque nee s 
following from each alternative strategy and would have to compare 
these consequences. He would have to know in every single respect 
how the world would be changed by his behaving one way instead of 
another, and he would have to follow the consequences of behavior 
through unlimited sets of values. Under such conditions even an • 

approach to rationality in real behavior would be inconceivable, 
■fortunately, the problem of choice is usually greatly sh'nplified 
by the tendency of the empirical laws that describe the isolated 
subsets. Two behavior alternatives, when compared, are often 
found to have consequences that differ in onl'y a few respects and 
for, the rest are identical. That is, the differential consequences 
of one behavior as against an alternative, behavior occur only . 

within a brief span of time and within a lirriited-rarea of description. 

If it were too often true that, for want of a nail,. the kingdom was lost, 
the consequence- chains encountered in, practical life, ■would be of such 
complexity that raftonal behavior ■would be’eome virtually impos s ible.; " 
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to be responsible for doing and coordinating the immense amount of staff work 
that will be required if responsible answers to these questions are to be o - 
tained? The many different offices within the university will need to be invol- 
ved to various degrees in order that their experience and training can be 
brought to bear on certain questions, but someone must structure, plan, and 
coordinate their efforts. 

In addition, consider a different type of policy decision--one that has been, 
reached this time by the president's cabinet and/or his council of chief campus 
officers that the present methods of counting graduate students is inaccurate 
and misleading and that some better method must be devised. 

But now this policy must be implemented. If your institution is anything 
like mine, a committee will be set up to develop a revised procedure and you 
will be its secretary or at least will be expected to provide it with data in 
copious quantities. 

By reading the minutes of the meetings at which this policy decision was 
reached or by talking to some of those who were involved m the meeting, one 
discovers that the university should distinguish between specific ^ 

araduate students, and develop a counting or measuring system^which is 
“'meaningful" for each type. Someone then must decide what categories or 
types are meaningful for this purpose, whether an approach based on student 

credit hours, work undertaken, or some other type of measure is to be used, 
and if student credit hours are to be used, whether a different cUvis or is to be 
used in the several graduate schools in order to determine the F. T. E. in each 
school, or whether a uniform divisor is to be used for all schools. Fma y 
someone must decide whether the registrar, the department chairmen, e 
graduate dean, or .the accounting office is to be responsible for the actual 
collection of the data and their transmission to those who have some interes 
in it. Where does policy fend and implementation begin? I am tempted to ans- 
wer that the question has no answer because it is not a meaningful question in 
the first place. 

Consider an example from a different field. The policy of the instituticm 
is to achieve a given standard of space utilization of its class laboratories. How 
is this policy to be implemented? First, we must know what our present rate 
of utilization is. and the answering of this seemingly simple question will im- 
mediately raise a whole host of difficult questions involving important pol^cy 
decisions. e. g. . what rooms do you count, what hours do you count, and who 
is to be responsible for the reporting and for the analysis? But th-is is only the 
beginning; we must then ask what we can do to improve the utilization, what 
alternatives are open to us, what the advantages and disadvantages of each are, 
what authority we must have to explore these in depth, and then how far we 
should actually try to explore each of them (e. g. , what are the educational 
effects of hour as opposed to hour classes on Tuesday and Thurs ay, 
evening classes, of block scheduling, etc.). This will lead to even more 
fundamental questions. What criteria should be used in evaluating J;he advan- 
tages and disadvantages of the several alternatives? Also, do we have the^ 
authority or perhaps the temerity to suggest that the original goal should be 
re-examined since the conditions which existed when the policy was _originally 
established have changed so drastically that it is no longer meaningful. 

The point I wish to make and emphasize is that there is always a need to 
delineate policy, that is to develop the implications of alternative interpreta-: .. 

tions of policy and/or alternative means of implementation and even of 

specifying the alternatives which will be cotisidered. This inevitably involves 
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a myriad, of policy decisions as these interpretations and alternatives are 
explored. The implementation of policy serves only to open a whole range 
of further questions to which answers must be found. I do not argue that the 
office of institutional research can or should try to do this job alone or even 
that it should be responsible for coordinating the efforts of the many persons 
who should be involved from time to time in these efforts, though this job 
must be done somewhere within the adininis trative structure of the university, 
but I am convinced that institutional research must play an active role in the 
process. As you can see, Ijthink of institutional research within a university 
as something akin to operations research in a large business enterprise. 
Operations research was done in business long before offices of operations 

were set up, and likewise institutional research was done in higher 
education long before offices of institutional research were established. But 
now that we have been institutionalized, we want to find our proper role and 
place in the administrative hierarchy. The purpose of operations research 
has been stated in Methods of Operations Research as ‘‘providing executive 
departments with the quantitative basis for decisions regarding the operations 
under their control. 

Does not institutional research ha^e the same purpose in the educational 
institution? Offices of operations research, too, are fumbling for their proper 
role, from pure research at one extreme to involvement in day to day line 
operations at the other. I think that we will have something to learn from them 
in this regard, and perhaps they from us. Howevef; one thing- see^ 

They have found that a central part of their role lies in the implernentation of 
the plans which they develop for consideiration by management, not that they 
substitute themselves for the operating tTvahag^^ment, ^ that it is essential 
that they interpret the plan and that they assist in the detailed development, 
including the evaluation and control aspects (which will presuinably be discuss- 
ed in tomorrow‘s sessions). I believe that this is equally tr.ue fbr institutional 
research- 
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What is the proper role of institutional research in the general areas of 
institutional policy? I submit the following. 

The role of institutional research in the formulation of policy is essen- 
tially an advisory function. The institutional research functions should be 
placed at the highest possible level of institutional manapment to minimize 
administrative filtration. However, it is this top;^ level location for an ^ 
tive role in policy formulation that makes policy implementation diffici^t t. 
avoid. The office of institutional research has the responsibility to obtam 
data of all sorts (including conferences, opinions, and reactions from a 
sources and levels), to collate them in an orderly and meaningful way,po 
t^erpret them, to point out their significance for effective institutional opera- 
tion to highlight those aspects which have significance for policy, and .. 
suggest a course or alternate courses of action where it is appropriate and 
necessary. This is the staff function. It is a decision- making function. 

Although institutional research may clearly point up or even recomrnen a 
particular method of implementation, the decision mup be made by top "^^n- 
agement. Actual policy implementation, however, is has ically ^ 
and should be carried out and directed by the operating unit. Industry foun 
this out long ago. 

Secondly, institutiona.l research should play a major role in the eyalu a- 
tion of existing policy within an institution. This involves not only an evalua- 
tion! of the particular policy in the light of institutional objectives, but includes 
as well the ev aluation of the effectiveness of t h e line operations_ _ ^^carry^^^ ^ 
out these policies. If insUtunonal research is to play a role in both the for- 
mulation and evnuation of policy, it should not be inyolyed in the, implementa- 
tion process. If this were the case, it would be difficult for the research ma 
to maintain an unbiased and objectiye frame of reference for evaluating a _ 
system for which he may also , have had the responsibility of implement 
In short, implementation and evaluation within the same agency seem o e a. 
contradiction in fact. Were it.not so, I suspect many consulting firms and 
accreditation bodies would have long ceased to exist. 

Institutional research is a staff function. It is not executive orTine, and 
as such, ideally should not make or carry out policy decisions. To the -extent 
that an institutional research office does get involved in the implementetion 
process, it becomes less capable and effective in carrying out the evaluative 
Lnctions. Also, it is more likely to operate under some other aegis than 
institutional research, such as administrative, academic, or institutional 
planning. As a viable entity an institutional research unit can be involved in 
the formulation and implementation process or the formulation and evaluation 
process, but not all three . 

This leads into another major role which the institutional research office 
can play, a role that has often been stres sed by many of those involved in 
institutional research. (This role was particularly well expressed by_^ 

Dr. Stecklein at the I96 1 American Council on Education rneetings in W g 

ton D. C. ) Basically the point is this: the role of an institutional research 

office should be to serve the faculty as welhgie:- the administratmn of the 
instituUon. and this service should be: in a dirfect as well indirect 
Many institutional research offices stress this particular function and have as 
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a consequence done much to bridge the gap that exists between the administra- 
tion and faculty, particularly in the area of communications between-and with- 
in these groupings. The extent to which this role can be accomplished depends 
on the degree to which the office of institutional research can remain both fish 
and fowl by keeping a foot planted firmly? in both camps. As anyone can tell 
you, this is an extremely uncomfortable, awkward, and tiring position to hold 
for any length of time, particularly if the chasm is of considerable width, and 
one has to bend over in order to keep his nose to the grindstone- It is a doubly 
difficult position to maintain since the majority of the requests for information 
and research will come from the administrative quarter. This has been 
counteracted to some degree in one of two ways: either both the institutional 

research officer and his staff come from the faculty, or they have joint faculty 
and administrative appointments. If we accept the liaison and interaction role 
as a desirable one, I would strongly urge that such an office exercise caution 
in order to avoid involvement in the implementation process or phase? The 
more an office becomes involved in policy implemenation, the stronger grows 
the administrative image. As a result, academic acceptability wanes. 

The institutional research function in our office, as you have no doubt 
gathered from the title- -educational planning, does invariably get involved 
with the implementation of policy. This is further pointed up in the fact that 
under the institutional research function only a portion of educational planning 
come sridirectly urit^r the Assistant Chancellor lor Planning and Policy Co- 
ordination. This office in which the institutional research resides also has a 
stated direct and indirect staff responsibility to the faculty as well as the 
administration. This relationship has been most difficult to rhainta. in behav- 
iorally for reasons previously mentioned, particularly because of the highlevel 
at which such an office is placed organizationally. 

Most institutional research offices, . no matter how assidu-ously they may 
try to avoid involvement in the area of policy implementation, do or will get 
involved in this role from time to time. Our own office has been involved to 
a considerable extent in policy implementation in such areas as curriculum, 
physical plant, student affairs, business affairs, and community affairs. 
Personal observations indicate that policy implementation is most effectively 
carried out by an institutional research office when it occurs as follows: 

1. for a short and predetermined trial period, and then preferably 
only if 

2. it is coupled with a previously and objectively conceived evaluative 
research design; and failing of these, only if 

3. you cannot persuade your president otherwise- 

In addition: the negative aspects of actively taking such a role are consid’r 
erably less when policy implementation takes place in the administrative as 
compared to the academic area . Policy implementation by institutional re<- 
search in those areas which are generally identified with the faculty and 
academic officers is one of the surest methods of becoming labeled as an 
administrator, rather than as an institutional research per son^ Formulation 
and evaluation are activities readily accepted by all groups; however, the 
implementation becomes a synonym for meddling and interference where the 
academic area is concerned. Once this ^si^ppe ns, it becomes increasingly 
difficAilt to involve the faculty as colleag^^;^ in or customers of institutional 
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research endeavors. Your evaluation process then becomes 

facility as a ‘procedure in which you provide "research (in quotes) t pp 

for0gori6 conclusions or decisions. 



However, there are times when a role in policy implementati^. is un- 
avoidable. When this is the case, it is most useful to the to involve as 

many outside people from existing line operations as possible in the implemen- 
SS procss/-bs they faculty o# adtuinietratoxe . This may be leee ^ff^t 
from the standpoint of time, but will be the best guarantee of maintaining the 
objectivity and the image of the institutional research activity. 



These remarks represent some of my beliefs and observations concern- 
ing what the role of institutional research ought to be in policy implementation. 
It will vary according to the organizational structure, the per sonal nature of 
the institutional leadership, the size of the institution, the nature of institu. 
tional control, and the particular background and characteristics of the 
incumbent institutional research officer. 



It is my observation that in the area of policy formulation, implementa- 
tion, and evaluation, the effectiveness and impact of the office of insUbJ^tional 
research is dependent upon how well it perceives and.maintains its 
relationship within the existing organizational structure, whatever that 
Structure may be. 
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If institutional research is to have an effective role in the evaluation of 
policy, it follows that there must be a coherent and complete codification of 
the existing policies of the institution. Far too often a modification of one 
policy is made without reference to its effect on other policies. An instituj 
tional research office can therefore first of all serve a useful purpose by the 
simple collection and cros s - indexing of all institutional policies. The idea is 
simple, although its carrying out is complex but not necessarily difficult. 

When existing policies are to be evaluated, the implication is that they 
are to be re-examined to discover whether they are accomplishing what tney 
were intended to accomplish. If they are not, why have they failed; and if they 
have failed, how may they have changed? As a matter of fact many, if 
most, institutions will find in the process of codifying policy that they have a 
good deal of dead wood lying about which ought to be discarded lest it turn up 
to plague someone at a later date. * 

The evaluation of policy will start with a. statement of the purpose for 
which the policy was adopted. This statement is basically of no concern to 
institutional research. However, when questions are raised as to the degree 
to which this purpose is being achieved, the problem becomes one for t e 
research personnel, not the philosopher, to answer. 

One or two illustrations may make the point clear. Institution "A!' -has 
an admissions policy which is based upon the premise that any graduate of an 
accredited high school is entitled to admission. However, classes are getting 
crowded, and budgets harder to conrie by. The question arises as to w*.l ether 
this policy should be changed. A careful analysis reveals that considerable 
numbers of students admitted under this policy are dropping out because of 
academic difficulties after one or two semesters. But, if it is to lie changed, 
what will be the result if the lower one-third or the lower one-half of a high 
school class is denied admission? How many fewer students ^ can be expected, 
what will be the effect on the retention rats, what redistribution of majors can 

be expected to result, and what will be the effect of staff load? All these and 
many others are research questions that need to be answered if any more than 
an arbitrary alteration is to be made in the admissions policy. 

A similar kind of situation might arise in connection with the policy of 
probation and academic dismissals, of adrnissions into certain citric u a a 
any level, or of any one of a hundred policies which might be cited. 

If policy is to be evaluated at all, it must be evaluated in terms which 
are essentially in the institutional research category, whether this work is . 
done in an organized bureau or elsewhere. Any other approach must necessar- 
ily be capricious and may alter a policy, which makes it in direct conflic wi 
another, or makes it appear absurd when placed alongside another existing 
policy. 

The fact should emerge quite clearly that no policy exists in strict 
isolation. Changes spread through the entire insititutional structure. T ere- 
fore, a centralized agency, familiar with all policies and able to bring - 
information effectively to the authority which is to alter policy, would seem 
essential. Anything less will invite the kind of chaos which exists in many 
campuses. 
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In a three-way division of the subject of evaluation, my.assignmen is 
consider (a) the extent to which objectives are met, and (b) the efficacy of the 
policies. The consideration of these two points necessarily assumes Dr. 
Howell's point that to evaluate policies there must be knowledge of what these 
policies are, and secondly, there must be an understanding of the purposes 
for which the policies have been established. (Parenthetically, I i we 
will agree that at least in the larger and more complex institutions, neither 
of these pre- evaluation conditions prevails--at least to the extent desirable 
for objective and meaningful evaluation. ) 

I will address myself later to the two topics assigned me, but before 
doing so, especially since the general theme of this conference is the concep- 
tual framework for institutional research, I feel a compulsion to add 
to the subject of the context within which institutional research can best be 
performed- -not only institutional research as a basis for policy evaluatio _ n , 
but also for policy determination and implementation. If by institu lona 
research we mean primarily applied research, formal or informal, engage 
in purposefully for the advancement of the total institution,^ then the platform 

from which, and the context within which, an institution-wide program of 

research is conducted becomes especially important. It is, by its very natur , 
a "staff" or service function, and not a "line" function. To a far greater 
extent than with most other "Staff" services within a college or university, the 
institutional researcher gets himself involved in the operational affairs- -often 
delicate and sensitive matters --of nearly everyone else in the university, from 
the president on down. Therefore, unless the office of institutional research 
wins its own way, not only with the central administration but also with the 
deems and faculty, to the point where it becomes an integral and natural part 

of the internal operation of the university- -both horizontally and vertically--^ 

and is truly welcomed by those responsible for line functions, it is do ubtfi^ i 
it justifies its own budgetary expenses or its own existence within the ins Utu-^ 
tion, regardless of how important we may happen to think the research finding 
are for the university. 

If this general premise is correct, then several oth«r points would seem 
to follow: 

1. The prime mover and coordinator of the institutional research 
program will function best if his office is an adjuct of the presi- 
dent's office. Essentially, he is an "assistant to" the president-- 
to help provide him and his central administrative officers with 
pertinent background information that will improve the quality 

of the administrative and policy decisions. He must, in fact, 
become an integral part of the central deliberative bodies (both 
faculty and administrative) if he is to be a genuine and productive 
partner in the enterprise. 

2. The actual research studies are not made solely or exclusively 
by the staff of the office of institutional research. The staff of 
that office can provide leadership and catalytic effects. However, 
conditions and understandings must be established throughout the 
institution that here is an office that has no axes to grind, that can 
work harmoniously with any department; o division of _the univer.- . 
sity, and that is concerned objectively and helpfully with all sorts , 
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of problems of institutional advancement. At this point. I s hoiild 
like to agree wholeheartedly with Sam Baskin in emphasizing the 
importance of working with faculty committees (and faculty mem- 
bers generally) in helping to advance knowledge, understanding, 
and concern about teaching and learning in specific relation to 
the institution's educational objectives. 

3. Given the first two propositions, one can see that the most effec- 
tive program of institutional research is not a highly centralized 
one, but rather a pi'-ogram which permeates the entire university. 

Here, I see no real conflict in the positions taken by Stuart Grout 
and Robert Hubbard on Sunday evening. True, they were differ- 
ent positions, but they ax“e not in conflict. Certainly there is 
need for a coordinating office of institutional research, as well 
as need for a great deal of research that will not be conducted 
by the administrators of the opei-ational programs, or by faculty 
committees. There is need for thinking time and for a kind of 
inactive leadership that w&ll not normally be provided by others. 

On the other hand, what could be better than an ins titutio nal 
philosophy which places emphasis on continuous, institution- wide 
self-study, with an office of institutional research aiding, leading, 
and coordinating these efforts at every point. There is rnore 
institutional research to be performed in each of our institutions 
than any of our centralized offices can possibly perforrri, so why 
not encourage all other Offices atid divisions within the institution 
to engage in various aspects of the total task? What is important 
is that there be adequate internal coordination and communication. 

It is my contentioa that some such context or conceptual framework as 
the foregoing must be established before an office of institutional research can 
expect to perform effectively either a catalytic or leadership role in the broad 
area of institutional evaluation. 

I wotild add that the internal relationships and conditions I have described 
are not always easy to bring about. Colleges and universities generally have 
not been run this way. Traditionally, and I think healthily, college and univer- 
sity administrators (both up and down the hierarchy) have enjoyed and expect 
to enjoy a fairly high degree of administrative freedom; and in most institutions, 
particularly the larger and more complex ones, there seems to be some confu- 
sion between academic freedom on the one hand and administrative freedom on 
the other, which of course puts a high premium on genuine organizational 
leadership at’ the level of the presidency. If this leadership exists, if the 
president believes in an administrative philosophy which places an appropriate 
value on the results of valid and pertinent institutional research on a continuing 
basis, and if the office operates within the foregoing context, the value of its 
role can hardly be overestimated. . 

Now, what about the role of the office of institutional research in internal 
evaluation? To what extent are the institutional (and policy) objectives being 
met? And, what about the efficiency of the policies ? Internal evaluation is 
not only a legitimate functidn of an office of institutional research but it is a 
necessary one. In fact the if ble of the ^ifice in helping to discern, establish, 
and implement policies would be weakened considerably if systematic and 

“t would seem that the eyaluation 

circle, because it is upon the results 
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objective evaluation were not to follow. I 
^ unction is the function that completes the 
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of policy evaluation that new or revised policies become discerned, estab is e , 
modified, or implemented- -and then again evaluated. However, I am not at 
all certain that these various functions of institutional research are that easi y 
separated. When one begins to conduct research to help in policy formulation, 
he is to some extent inevitably assessing the value of existing policies--or t e 
lack of them. Therefore, while I find it valuable to thi^ of the role of institu- 
tional research in evaluation, it is difficult to isolate this role from all of the 
others of which we have been talking for the past two days. 

In this connection Paul Dressel speaks of the "inevitability of evaluation. " 
If by evaluation we mean judging the worth of a policy, a procedure, a program, 
or even of an experience or an idea, then this certainly takes place every day 
on every campus, by every office, and by every professor. The point is that 
we have seldom applied the standards, criteria, or research design to the 
evaluation of institutional policies and practices that the researchers in the 
disciplines apply in their own disciplinary research, which of course ra',.ses 
the whole Question of criteria, a big subject for another paper or for the group^ 
discussion to follow. It is commonplace to cite the tendencies of even research 
scholars to hold and to express strong but highly subjective opinions on matt 
outside their own fields of competence. It is also commonplace to cite the 
tremendous resistance to change of college faculties generally, especially w 
the matter under consideration relates to teaching methods or curricula. 

In view of the inherent nature of colleges and universities, and especially 
their faculties, I submit that we should not expect widespread immediate, or 
spectacular, results in the area of policy and program evaluation. However, 
in the long run, if the proper internal climate is established, if an outstan ing 
reputation for quality in institutional research in gradually built-up and con i- 
dence established, and if both administrators and faculty are constructive y 
involved in the processes, then the evaluation role of the office o ins i u lona 
research is perhaps its most important role. 

All that I have said in this regard relates equally to the five areas of 
policy singled out for special consideration in this oonference, _namely: ( ) 

whom the institution shall serve; (2) type of faculty sought; (3) means o 
financial support; (4) the building of facilities; and (5) the curriculum. 
However, these areas are the subjects for our group discussions, and I hope 
that the problem of criteria and standards for evaluation studies in these areas 

will receive attention. 
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year, six might be considered evaluative stuaies. 

Tn aonroaching this topic I want to consider first some of the techniques 
and problems involved in ?ns°tiS:i^nLl Re^'' 

measured Some years ago^^^ observed that one should obtain two 

;re\^t o"f informaa^^^^^^^ a statement °f the purpose of 

the survey, and an agreement that the type of information supplied will be 
acceptable as an answer. ^ 

After trying other approaches. I have concluded that Morris is coTVBct. 

the vice president requesting such information. ° ® ^ third form seemed 

three forms would really not tell him anything, but ^hat the third fo 
wJll sSted to his needs.' This brief trip accomplished two thmgs: (1) it indi- 
r^ted Sat oni report would be sufficient for the uses of this vice president^, 
and IZ) that he still wanted the information. I am neither suggesting t a 
i^esiarfto ha^ jreUe approve every table and etep in the gathering and 
rep^tTng'^proceee nor eaying that one ehould find, the 

order to supply the approved solution, but it is necessary to be certain that the 
tMnge 4ITfinding Kv. a cloee relation to the probleme needing etndy. 

As suming one can obtain a statement on the information wanted, there _ 

still is a problfm of entering into studies^for which_th^ 

von are aware of such studies; for example, which i.s best, th^ quart 

^ ? ''rVie fact that * *x* * nurcibe r of schools have it one way and 

semester system? Phe ■ the fact that the mem- 

"y" number another way does not tell mucn, . . hotter although 

hers of the faculty have different opinions on the subject. A ® 

orobablv useless, survey of the merits of a semester versus quarter 
system m^ student attrition in the two ^'^ems 

illdemic knowledge gained, number of library booke «„7°uch 

and other su-^h information. Even then, assuming it possible to find sue 
Inewe^' Sni might -not eupply information which would have any influence on 

the system adopted. 

In evaluation studies it frequently evolves that one must 
nrocess the policies or objectives which apply, for they are seldo 
4rw4n tSey appear at all,are sufficiently 

Another problem is that the persons wanting a study may fail to 
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Evaluations in Curricular Matters 

In the winter and spring of 1963. the Assistant Academic Vice President 
made plans to conduct a large- sized summer quarter which had been approved 
by the President and the Board of Trustees. While the University 
had previously operated on a four-quarter system, the new plans called for an 
enlarged offering of courses, more faculty, and increased pay for summer 
teaching. The Assistant Academic Vice President wanted to evaluate th 
enlarged summer quarter. In planning the survey we deterrnined to review 
enrollment increases and to distribute a questionnaire to students enrolling in 
the fall quarter of 1963 which would seek their reactions to the summer quar 
ter if they attended, or, conversely, ask why they had not attenaed it. The 
questionnaire was modeled on one Joe Lins. Director of Institutional Studies 
at the University of Wisconsin, used a few years ago in a more elaborate 
survey. ^ We printed the questions on a data processing card which was c 
lected during the fall quarter registration. The student checked certain 
responses, while other information was added from data already stored on 
each student. Answers to such questions as the following seemed pertinent. 

1. Did enrollment increase in a significant manner? 

2. Where should emphasis be placed in recruiting to increase the size 
of the summer quarter? 

3. What scheduling difficulties did students have? 

4. What improvements were needed in the summer quarter? 

5. What reasons did students have for not attending the summer quarter? 

In brief the survey disclosed that anrollment increased significantly, that 
scheduling problems were no more difficult than in other quarters except for 
certain graduate students, that the longer a student remained in^ school the 
more likely he was to attend the summer quarter, and that most studems wh 
had attended the past summer and had not graduated planned to return the 
following summer, while most students who had not attended the summer 
quarter did not plan to enroll in it. 

In another survey in the general area of curricular evaluation, Gei'ald 

Whitlock, of the Industrial Management Department of the University of 

Tennessee, and I reviewed the effectiveness of pre^cpHege courses in s 
fields as "How To Study, " "Rapid Reading, " "Rerhe dial Afe thematic s, and^ 

Remedial English. In this study we reasoned that considering the tmie the 

courses were offered, the group to whom- they were offered, and the content, 
the objective was success in collegiate courses. In order to rneasure is 
objective, we selected a control group of students with characteristics like th 



^ L. J. Lins, "Student Reactions to 1961 Summer Sessions at the University 
of Wisconsin, Madison Campus" (mimeographed. University of Wisconsin, 
1962 ). 

^ This research has been published under the title "College Preparatory 
Course Work, " in L J. Lins, ed. . Basis for Decision , Journ al of 
^Experimental Education, XX^Q, No- 2, 1962, pp- 188-9Q' 
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sample group, collected academic results in college courses on each group, 
and performed a "t" test. The college grades of students enrolled in such 
courses when compared with a control group indicated that the courses either 
failed to help or even hurt the individual concerned. While these same courses 
are still offered in the University, publicity concerning them is not as 
enthusiastic as formerly. 

The Executive Dean of Student Affairs wondered what effect living on or 
off campus might have on the length of time a student remained in school and 
on his academic grades. He wanted information on whether or not rooming- 
boarding houses affected the academic performance of students occupying 
them. 



In order to conduct this study, we collected information concerning 
housing, persistence in school, and grade point average on an entering fresh- 
man class over a four-year period. Then, in brief, we compared students 
dropping out as a function of place of residence, organizational membership^, 
and sex and tested any differences obtained by use of Chi-Square analysis. If 
you are somewhat confused by this study, do not be alarmed, for we have not 
been able to simplify it sufficiently to write it up. 

A rather quick and probably unproductive survey resulted from a request 
from the Assistant Dean of Admissions and Records to compare the acadernic 
accomplishment of international students enrolled in the Department of Civil 
Engineering with citizens of the United States. This survey probably /failed 
to accomplish as much as it might have, for the researcher failed to ^ talk with 
members of the Department of Civil Engineering in order to ascertain what 
was the purpose of the study.. It developed that only students from India and 
China were numerous enough to be \ised in statistical tests. It was possible 
to compare by use of a "t" test each group of students with a random sample 
of native students. The survey showed that the students from one of these 
overseas countries achieved higher- -but not to a significant extent--that native 
students, while the other country sent students who performed significantly 
poorer. 

Another evaluative survey in the general area of student personnel 
management developed when one of the vice presidents asked how many high 
school students who came to the campus during various high school visitation 
days returned to enroll as freshmen. He wondered if the individuals being 
entertained actually enrolled.. The survey revealed that about 20 per cent of 
the visitors entered. Immediate results followed. The Alumni Secretary, 
who coordinated the visitation progra-.m, reviewed his record-keeping system 
and found that he had missed recording the names of some of the individuals 
who had visited the campus, and he also found that many of the visitorswere 
not seniors or even juniors. Consequently, the Alumni Secretary is now 
striving to get his alxxmni workers to bring only high school juniors and seniors. 
In addition, he has some material which allows him to ask his alumni workers 
what is happening to students who visit the university but do not elect to enter 
it. 

The above examples are rather limited in the field of student pe^rsonnel. 
Several people who work in the general area of ins;titutional research'such as 
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John Hills. ^ Warren Willingham. ^ or Clifford Wing. ^ are doing good work in 
evaluating admission policies and admission testing procedures. 

Evaluation of policies in Fiscal Affairs 

Increases in the number of students and rising costs have led university 
administrators and state governmental officials to a^k more and 

concerning fiscal expenditures. The states of Florida. Indiana, and Texas, for 
example, use a formula approach in dividing state funds amon^g institutions 
highe? education. Institutions in these states as well as in others, the ref o , 

are collecting cost data in order to substantiate budget 

sities Study. ° of which John Swanson is director, is striving to ^ 

Ix7t! procedures and policies used in colleges and universities to allocate 
funds and to make cost analyses. Cost analyses play a part in the 
of policies. Since this subject is rather complex and has been discussed in 
previous forums, there are only two points I want to make concerning it. (1) 
Leroy Hull of Indiana University has just completed a publication directing the 
cost analyses system used, by the state of Indiana and (2) institutions 
cost studies need to evaluate such studies from time to time in order to make 
certain that helpful and usable data are being obtained. 

Policies related to capital construction projects are in the catepry of 
evaluative surveys since it is necessary to evaluate usage and needs before 
considering a new building. The typical space study frequently is limii^d to 
utilization of classrooms. Since little or no attention is paid to the 
faculty members, and their offices or to bottlenecks resultmg from 
difficulties in much-used demonstration classrooms . .^ 

space needs may not be pinpointed in space surveys, although the administra- 
tion and the faculty involved are keenly aware that if 

does not always take an elaborate or complicped space study 

enrollment is increasing by "x" numbers, and this increase [ 

professors while there are only "z" number °f Vn 

needs to be done by someone regardless of whether there is 40 
utilization of general classrooms at 9:00 on Monday. Wednesday. 

I am certain that we fail, or at least I fail, to supply the right evaluative mate 
rial for good management decisions on whether or not to construct a ^ 

building or series of buildings. The result is that by some ppce&s ^a_ building 

is decreed, and then someone is asked to supply the justification. While 
elaborate cases can be made for such buildings. I still believe this is a re- 
versing o£ the process. In s ummary. l am. sugge ping that 

and the individuals supplying information need to join forces and arrive at s 
beLr questions to ask in order that more helpful data appear in space surveys. 



^ John Hills, Director. Office of Testing and ckdance. Regents of the 
University System of Georgia. 

^ Warren Willingham, Director of Evaluation Studies, Georgia Institute of 
Technology. 

^ Clifford Wing, Dir&ctor of Admis si^jis, Tulane University. 

^ A national survey on terminology and procedures in fiscal matters. 
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Evaluation of FaciiLty Members 

Evaluations of the faculty are hard to make, for it is frequently difficult 
to decide what to measure, much less how to do the study. Another complicat- 
ing factor is that the research, when completed, is written off as the work of 
a madman or one who fails to know the ”true” facts of the case, whatever that 
may mean. Teacl-ing effectiveness, research production, standing in the 
academic world, or even descriptive information on degrees, ages, and colleges 
attended are items on which information is wanted. 

Our adininistration and faculty endorse a policy of developing a bet^ex 
faculty. By expenditures of money and much hard work in recruitment and 
leadership, we have made efforts to effectuate this ideal. Here are a few of 
the ways we evaluate the success of our efforts: 

1. By comparing increases in faculty pay with increases in similar 
institutions on a national level. 

2. By comparing the, number of faculty by degrees held by academic 
rank with earlier internal studies and also with other institutions. 



3. By comparing median age of faculty members by college and rank 
with other institutions. 



Normative data from the United States Office of Education, the National Educa- 
tion Association, and certain institutional research officers who have generous- 
ly placed me on their mailing lists make such surveys possible. Although 
rather time consijcDaing, such surveys on the faculty may help to locate 
potentially critical areas. 



However, there are many other more elaborate studies possible. Gerald 
Whitlock of the University of Tennessee is currently experimenting with a 
teacher rating sheet which allows a student to grade the professor on an *^A 
to F” scale and to respond to a series of 43 questions. He is now in the process 
of comparing each response checked with the **A to F** scale. Whitlock reports 
that a common denominator of **F^* teachers is the response checked by students 
indicating that the teacher appeared unprepared. Whitlock is still at work on 
his survey. Galen Dr ewry, one of the discussion leaders in this For urn, has 
also attempted to evaluate teaching effectiveness as have many others. / Much 
work remains to be done in teaching evaluation. 



In the University of Tennessee we have not tried to evaluate faculty re- 
search other than by counting output of published articles and books, a highly 
inadequate but widely used approach. If we evaluated research on the basis of 
publication in only the **leading** journals of given academic field or on the 
number of times an article is cited by other authors, some interesting meas- 
ures of research output might occur. Administration and feLLow faculty 
members would probably welcome assistance in measuring rdsearah 
competency. / 



^ For example, see N. JL. Gage, 
■'^^Natly and Co. , Chicago (c. 
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Another field which might prove useful in evaluation of faculties is the 
measurement of public service functions or contributions in general to the 
university or college, community, or society. In addition, we 
based on feome process of rating, that certain personnel fail to fill the p 
tions adequately while others overflow their area; the result is a'change in the 
organizational chart. Perhaps one of the discussion groups will uP with 

some ideas on the prediction of such behavior or measures of the effects of it 
on the institution. 

In conclusion, one point cannot be overstressed concerning evaluative 
surveys. Unless policies and procedures are reduced to questions (or hypo- 
theses) about which answers can be obtained, and unless the data collected 
are meaningful to the person who wants or needs the survey, evaluative studi 
a^e wSout ®vSu^ FiLlly. I suggest that the work of the office of institutional 
research is itself a subject for evaluative study and that it is necessary to giv 
attention to such a topic before a successor undertakes the J°b for you. 

Without doubt there are many types of evaluative surveys- -good luc w 
yours ! 
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James I. Doi 
New York University 



My assignment for tonight, as described by our conference chairman, is 
••to more or less sum up or synthesize what has been described in the 
sessions, coming up with the speaker's own point of view --in short, to present 
what sort of conceptual framework for institutional research has been 
’’hammered out. ** 

In pursuit of this mission. I have dutifully attended the general panel 
discussions, as have most of you. and listened with an open ear. / , 

mouth, and hopefully a resonably unprejudiced mind. I must confess that with 
each testimonial of individual experience, preference and point of view I 
found it increasingly difficult to hold to an unprejudiced mmd- Yet I thi^ .. 
made a valiant effort, for this morning I awoke unnerved and somewhat 
confused. 

So it is with a feeling of uncertainty that I stand before you to present, 
for your consideration a frame of reference for interpreting and. to some 
extent, for synthesizing the points of view, the concerns and issues expressed 
by the various speakers. I shall briefly sketch the major elements bf this 
frame of reference, then proceed to the summarization and synthesis of that 
which I believe has been "hammered out. " and finally indulge m the expression 
of a few of my own prejudices and observations regarding institutional researcti. 

My frame of reference consists of the following which I shall state in the 
form of propositions: 

Proposition 1: That there has occurred an evolution of institutions of 

higher education from small organizations which were relatively simple in 
structure and function, characterized by student bodies and faculties sma 
enough to permit a high degree of interpersonal communication (that is... small 
enough to maintain a unified campus culture), and operating in a social order 
which made relatively few and simple demands on them, t«o large- sea e. com- 
plex organizations which are striving to perform a multiplicity of lunctio ns, 
characterized by large student bodies and faculty populations, and operating n 
a social order that pushes and pulls them., imposes on and. at times, coerces 
them in manifold ways. In the course of this evolution.-Trom ™ to larje 
organizations, institutions have come to resemble the classic bureaucr 
structure and mode of operation. (Having used the term "bureaucracy. ■ let 
me hasten to say that I use it in a neutral s ense - -simply as _a term use y 
sociologists to describe a formal organization characterized by clear-cu 
division of labor, a system of differential controls and sanctions ^state in e 
form of rules and regulations, the assignment of ^:ole:V to office -holde rs b^^^ 
on technical qualifications, impersonal orientation of cont;?^ts between ° 
and clients, and a structure of hierarchically arranged authority. The chief 
merit of such an organization, at least as Weber saw it, is technical efficiency. 

Proposition 2: That there is occurring in American higher education a 

change in the style of administration from the non- scientific to the scientific, 
the latter being characterized by the extensive use of knowledge as a basis for 
decision-making. (Gordon Tyndall, in his provocative paper, spoke on this 
phenomenon, so'I shall not dwell on it further. ) 

ebIc gs 
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Proposition 3: That the production of this knowledge, institutional 

search, has in many colleges and universities evolved from a form of organi- 
zational behavior characterized by sporadic studies and collections of date to 
a form of behavior characterized by coordinated and systematic review of 
research needed for institutional improvement and by the recognition of this 
process as a continuous, day-to-day function. 

Proposition 4: That in manv colleges and universities institutional re- 

search, which for years was performed sporadically by administrators, 
facultv members, and ad hoc study committees, has become a function of 
specialists--persons who are trained in research techniques applicable to 
studies of institutional operations and who by virtue of their expertise are 
appointed to and accorded a distinctive place in the organizational hierarchy. 

Proposition 5; That these specialists, collectively, are becoming a 
distinct professional group consisting of persons with a colleagial sense of 
identity "^dth others engaged in. the: performance of comparable services and who 
share with one another concerns over the identification and development of a 
specific body of expert knowledge, guide-lines for professional conduct, etc. 
(This conference itself is symbolic of the recent emergence of a rather sub- 
stantial body of specialists who talk and woryy like professionals. ) 

Before attempting to use these five propositions as a frame of reference 
for integrating and synthesizing the various points of view and concerns ei^ 
pressed in this conference, I would like to take a moment to comment on the 
signiiic-ance of the order of these five propositions and my choice of certain 
terms. Bet me restate briefly the five propositions: '1) the evolution of insti- 
tutions of higher education from small, relatively simple organizations to 
large-scale, complex organizations essentially bureaucratic in structure and 
mode of operation; 2) the emergence of a new style of administration, which 
for lack of intellectual energy to search for a better term, I have described 
as scientific; 3) the evolution of institutional research as a form of organiza- 
tior behavior characterized by sporadic studies and collections of data to 
that c--iaracterized by coordinated and systematic conduct of studies needed for 
institutional impr ovom.ent; 4) the emergence of institutional research special- 
ists; and 5) the professionalization of these men. 

The or^er of these propositions ia intended to suggest that each succeed- 
ing development is , a consequence of the preceding developirient. The e.mer- 
gence of the IR specialist as a professional and as an office holder in the organi- 
zational hierarchy was dependent on the change in the nature of IR as a form 
of organization behavior. For this change to have occurred there had to take 
place a change in the style of administration. The evolution of this new style 
of administration is not only compatible with but a logical consequence of the 
evolution of institutions 6f higher education, especially the universities and 
1 : rge colleges, from small, relatively simple organizations to the large and 
complex. 

There are two terms crucial to this frame of r eference - -"evolution” and 
"bureaucracy. " My use of the term "evolutionV' may best be understood by my 
avoidance of the term "progress. " Both connote change. But progress also 
connote-s movemient toward some ideal objective — an objective that is defined 
by a particular set of values. One may speak of evolution, however (i. e. , 
change from the simple to the complexhwithout imputing value judgments. 
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I do not necessarily regard as progress the fact that today the 
form of institution of higher education in the United States is the large, co^^ 
university or that a small institution in becoming large exhibits the characteris 
tics of a bureaucracy. Nor do I take pleasure in suggesting that in order to 
appreciate fully the points of view, concerns, and issues expressed ^ this 
conference, we look upon ourselves as specialists ^ 

bureaucratic organizations.. But I believe I am speaking of fac,.s oi life- -re 
ties that have been amply reflected in the statements made by the various 
speakers. 

Let me now proceed with the interpretation of what I believe I heard in 
the context of the frame of reference that I have just described. 

The various spea.kers were in complete accord on institutional research 
as a staff, and not a line function. They were also agreed that institutional ^ 
rese£7^ should engal^in the evaluation of policy. Since 

cess generally involves studies and research, the speakers appeared confident 
of the role of IR in performing this function. There were also consensus on 
the role of IR in the formulation and implementation, of policy- -specifically that 
it does not. rather should not, directly formulate or implement ® 

role of IR is apparently to engage in various studies and analyses desig 
produce information that will assist line officers and policy-makers in the 
execution of their tasks. 

Given such a high degree of consensus on the role of IR in the formulation, 
implementation, and evaluation of policy, it would seem that we have indeed 
hammered out important guidelines and can tomorrow return home and perform 
our role with great confidence. Yet the climate of this conference does not 
strike me as one of confidence. I am tempted to suggest as an ^propriate 
title for the proceedings of this conference the following: The Proceeding 

an Emerging Profes sion- -Nervous of Its Status, Uncertain of Its Role, and at 
Variance on Style of Operation. " 

Specifically, I refer to the fact that while the conference topics suggested 
discussions of the generalized role of IR. much of what was said dealt with 
questions of the status of the director of IR in the institutional hierarchy, his 
role, and the style of operation. 

In regard to status, several of the speakers stressed the importance of 
reporting to a line officer at the top of the administrative hierarchy- -the 
president himself. Others seem content to report to the vice president 
academic affairs or the provost. But these are only two of many places in the 
hierarchy where IR men (and women) are located. Furthermore, the t t 
vary- - director, coordinator, administrative assistant, assistant to e 
president, dean, assistant provost, etc. 

In regard to role, what the IR director does in his relationship with 
others, it is obvious that one must look beyond general descriptions of functions 
such as "to perform studies. " and "to assist. " Som^e IR men^t^ke the 
view that like Sergeant Friday of that once-popular TV show Dragnet, they 
search for and report only the facts. Judgment is for the judgv3 an jury, 
ma'm. " Others like Sam Baskin of Antioch College take a more aggressive 
role. They regard themselves as active "agents for change. They not only 
gather facts, but they also influence, persuade, cajole, and perhaps at times 
find themselves threatening. And still others seem able to perform e ro e 
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court Rasputin. I one© liBard it said of a director of IR that his president 
't make a decision 3-bout the university without first consulting him. 

One also finds that in some institutions the office of institutional research 
irimarily project-oriented--that is engaged only in atudies that are requested 
t by other offices and committees. It is not unusual for such an office of 
dtutional research to limit itself to a rather narrow range of studies--for 
mple, the collection of data relating only to class size and teaching loads 
lie analyses of enrollments and student characteristics. In other instances, 
office of institutional research stresses the institution-wide coordination of 
srnal studies and the identification of areas that require study. Such an 
ce also undertakes studies on its own, but, generally speaking, attempts to 
it them to types which can best be done by a central agency rather than by 
operating units. 

How can one account for these variations in status, role, and orientation? 

The single, most important factor underlying these varialions, I believe, 

;he degree to which an institution is committed to the new^ style of adminis- 
tion. This new style, as previously stated, is characterized by reliance on 
iwledge as a basis for decision-making. Where there is a high degree of 
nmitment to the new style of administration, there will generally be found 
.r or at the upper stratum of the administrative hierarchy, in one forrn or 
»ther, an office of institutional research which both coordinates and directly 
rages in IR projects. Where there is a low degree of commitment, there 
i be found an office of institutional research, or something approximating it, 
t is project-oriented and that has little or no responsibility for coordination 
1 continuous review of needed research. 

While each of us has his pet viev/s on specific administrative arrange- 
nts — that is, whether the IR director should report to the president or to a 
e pi’esident, or whether he should be called dean, director, or coordinator 
I importance attached to IR as an organizational function is related to the 
■le of administration. This relationship suggests that the use made of an 
ice of IR can be expected to vary with changes in key adm.inistrative officers, 
e cannot assume that all men who gravitate to presidencies and vice presi- 
icies know how to use an office of IR or want to rely on its services. There 
3 still men who,, as key administrators, believe in attaining institutional 
jectives by means of dead reckoning, who attempt to pilot the ship with the 
ring and courage of old-time aviators. The future of institutional research 
s with the increasing number of administrators and faculty groups who look 
an a modern institution of higher education as a complex, fast-moving ship 
ing in congested airlanes. 

■Before leaving the subject of things discussed in this conference, I should 
rernis s if I were not to attend to the question, of wxie"' an office of IR shou..<.d 
administration- oriented, faculty- oriented, or studem-oriented. Generally 
eaking, institutional research as an organizational;';function has been and 
ntinues to be administration- oriented. But here again, I return to what is 
Lp.licit in my frame of reference — natnely, that total institutional commitment 
the part of both faculty and administration to the use of knowledge as the 
sis for decision-making has yet. to evolve. .A.S has been often observed, 
aulties are basically consei'vative on matters pertaining to institutional 
ange. An office of IR is perceived by many faculty members as another 
necessary appendage to the administrative bureaucracy. Moreover, the use 
at IR so often makes of data processing equipment and -procedures tends to 
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reinforce faculty fears that it may be just another development contributing 
to depersonalization. 

Thus far, I have spoken of IR particularly in terms of manifest functions, 
that which we believe and say to be its role in institutional decision-making. 

I have tended to impute to these manifest functions positive values The co- 
ordination and conduct of studies, the identification ox 7®. 

instigation of changes, and various forms of assistence rendered ^ 
trative officers, faculty, and student groups are things we say we 
the belief that they contribute to organizational efficiency. Now let me r 
to the question of malfunctions- -things that might happen to reduce the effec. 
tiveness of the office of IR. I shall limit my comments to those things which 
are directly controllable by the director of institutional research. 

The first that comes to mind is the IR man who starts as a specialist in 
the design and execution of a limited range of studies and continues to be 
merely just that, usually by failing to extend his competency in 
techniques and his comprehension of colleges and universities. , ^ 

than any other single factor, can lead to his becoming a 

appendate. Not infrequently an institution will appoint as IR directo^r an _ 

vidual with competency in certain kinds of studies that are o± imrne la e 
est to it--for example, budget analysis and cost studies, or enrollment pro 
lections and student characteristics, or curriculum analysis and educational 
experimentation. Within a two- or three-year period, studies of a 
should become a matter of routine and the institution, reasonably well informed 
of the situations encompassed by them. Other problems in , 

quiring analysis may then come to the forefront. The director of I 

able to provide the knowledge and leadership in the study of such other problem , 
if not, the administration will.have no other recourse but to regar ® ° 
of IR as a repository of more or less routine, perhaps even unimportant,, 
studies. By knowledge and leadership, I do not mean that the IR director 

should seek to become an expert in every type of achieve- 

the attempt to become such a:.complete expert is admirable, I doubt that ac 
ment is possible. As a minimum, however, hfc shoiild acquire knowledge of the 
kinds of studies developed by others engaged in research on kigher educati 
and of their relevance and applicability to the problems faced by his institution, 
so that he can, through staff appointments, by appeal to faculty members inter- 
ested in participating in various types of institutional research, an r ug 
judicious use of consulting experts, get the job done- 

A second way in which an IR office may malfunction is for its director to 
use information gained from the studies as an instrument for extending personal 
control over administrative areas or for solidifying his st3;tus in t e a mini& 
trative hierarchy. He must undertake studies, but of equal irnportance is that 
he disseminate the findings to appropriate persons within the institution. His 
function is not to spring surprise information parties at the conference table, 
or to be so secretive about his work that his administrative colleagues begin -o 
feel that he knows something about their operations that they don t know^ With- 
in four or five years in a given institution, a director of IR is i e y o 
his command a wealth of data about practically all aspects of the Pla-ce- 
occur during that period changes in administrative', posts, he should be available 
to play an important role in familiarizing incoming officers with the institution. 
The director of IR. above all others, should resist any temptation to put a^new 
man in his place by displaying, at the conference table, uncommon knowledge 
about the latter's domain. 
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Another form of malfunction, one which has been frequently cited in this 
conference, is for the director of IR to attempt to implement policy while still 
assigned to IR. There are two common manifestations of this. One is the IR 
director who forgets that his role is staff and not line and attempts to take over 
the line officer's area. This requires no further comment. The other, which 
is surprisingly common, is the man who wears two hats--one line and the other 
staff- -for example, the man with the title "assistant provost and director of 
institutional research. " I myself once committed this sin, and while there may 
be persons sufficiently adroit to balance both hats, I must confess that in the 
time I attempted the feat, institutional research suffered. Here I am referring, 
of course, not to the IR director whose status has been enhanced by an addi- 
tional title, but to the person who has been assigned critical line functions (i. e. , 
decisions regarding promotions, appointments, fund distribution, etc. ) in 
addition to the staff functions of IR. Quite aside from the difficulties of attempt- 
ing two jobs, which are readily imaginable, the objectivity of the IR efforts is 
likely to come under attack. Is the man manipulating the data so as to make 
his decisions look right? Is he using the office of IR to study primarily those 
topics which are of immediate concern to him in his line capacity, ignoring the 
informational needs of other officers? 

Another form of malfunctioning occurs when a director of institutional 
research gives in to the urge to undertake a project that interests him mightily 
but which, at the same time, is likely to be disruptive of institutional morale 
or to aggravate an already unhappy situation of institutional anxiety. insti- 

tution, during any given period, is willing to subject itself to certain kinds of 
studies but not to others. A director of IR must be able to sense these organi- 
zational moods, speedily to put a halt to a proposed study, and just as readily 
prepare for another on his agenda of "things to get done" which is more toler- 
able to the institution. For example, the faculty morale study which John Dale 
Russell undertook several years at New York University could have been 
attempted at the University of Colorado in I960 but not in 1963. A question- 
naire asking faculty members to report annual income from consulting and 
similar extracurricular professional activities might be tolerated by the facility 
of one university, but in another it would create a major furor. The function 
of IR is not to rock the boat, but to enable the steersman to set a wise course; 
if the search for navigational data might result in rocking the boat, the 
steersman should be so advised. 

That the director of IR and his staff should assiduously observe the confi- 
dential nature of certain kinds of data and record to which they may have access 
goes almost without saying. Closely related to the breach of confidentiality is 
the publication, of a study, the contents of which may be such as to cause 
embarrassment to the institution. Just as some institutions are able to tolerate 
certain kinds of studies which others are not, some institutions are better able 
than others to withstand having their "guts" revealed to the public. While 
Johnny Ivlorris was Director of Institutional Research at the University of 
Mississippi, he used to say,,that the most interesting studies seldom see the 
light of day; they are usually discussed within the confines of the conference 
room, the findings acted upon but not widely disseminated. The post of 
director of IR requires the exercise of restraint of the urge to publish. One 
of the values of professional meetings of this kind is that it gives us a chance 
to exchange notes on the techniques and findings of our unpublishable studies, 
on a more le s s - confidential basis. 

These observations on malfunctions, the.Tive cited by no means being the 
O j ones, are sufficient, I hope, to suggest- that an office of institutional 
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IR staff. 

In the final section of this somewhat extemporaneous commentary, I 
would Hkl to a few obeervatione on the development of an asaoc^at.on of 

professional IR workers. 

Institutional research has been characterised W gte^ Tu'Jrature Tve"ry 
years This vitality is manifested in the growing body of IR ^. . J 

lubstantial increase in the number of IR workers and 
among college and university administrators of the need for and 
institutional research. 

This afternoon we took an important step toward 
appointment of a constitution committee for ‘h® = f Jf^dict- 

workers That such an association would one day come into g j.,P 

a few years ago I see no point in attempting to resist it. as I did a year 
Jgo 1 do m|e. however, that the proposed association in its constitution and 
bylaws avoid restricting --tnbership by a r^gorous^set^of^q^^^^^^^ 
defining who is or who is not a professional from the very lack of 

institutional research, I believe, stems pj^lons pl^Iicipating 

an established norm of who is or who is not an IR man. person p 

in this and previous forums represent f =j;P';^Ys;i'ence^^^^ 

havioral sciences, business management, 

education, etc. Their titles vary; they come from colleges and univer , 

from governmental agencies, and state and ^ air 

This diversity may irritate some of us. and it probably contributes to the air 
of uncertainty as to what institutional research is, can be, and should . 

I believe we should treasure this diversity and retain it in the proposed 

associltirso that we may continue to -ap the contribution it m^es to the 

vitality of institutional research as a force for improvement of our colleges 
and universities. 
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The Modern Info rmation Explosion 

University and college officers have the increasingly difficult task of 
controlurg expanding inetitutiona. This is because the educaUonal test.- 

tution like most other organizations, is feeling the effects Oj. t e in orma lo 
explosion--the creation of more and more information about more and more 
things Students are seeking information that is constantly changing p 

‘up w®Uh tfe technical and social changes in our developtng 

The ability to use information of all kinds with great efficiency and flexibility 
is central to controlling educational institutions under these circumstances. 

To cope with their new problems, the university and college officers 
need new concepts of information processing. These new concepts require 
advanced data processing techniques, advanced analytical tools, and new 
orgJmzational structure! One new concept of university and college adminis- 
tration which has promise of being a significant ^elp is the ^Untio^n 'cI t T ^ 

College Information System (UCIS) --a framework ^^^ich each ins tit^ 
modifV to create a management control system which will help those in charg 
solve today's problems and plan for tomorrow's needs. 

The IBM University and College Information System evolved from a total 
approach to the informational needs of all elements of the msitution. There- 
f!!e. the system requires the support and coordination of ' 

These officers will be rewarded for their efforts by having at their fingertips 
better information for decision-making than would be poss le through any 
lesser system- 

The Scope of the University and College Information Sy ste 

The IBM University and College Information System elates to all ele 
ments of the university and college administration and is 

major areas: Student records, financial administration, md planning and 

developme nt. 

1. Student Records 

This area deals with applicants, students , and alurmn. The ultimate 
student record system would begin when a student first enters 2 

school and end with his decease. Some educators have called this a cradle to 
the grave" approach. Short of this idea an individual insmution can organize 
its own system of student information into a total approach. 

The concept of UCIS is to establish an individual master record for each 
student in electronic form, as a result of the admissions process. This rec- 
ord will be added to and drawn from by the other functions of testing and coun- 
seling. registration and recording, student services, and alumni records. In 
addition to serving all parts of the student record system, the student master 
record will provide current and complete information for the benefit of such 
financial operations as student loan accounting and all the student data needs of 
planning and development. 
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2. Fi nancial Administration 

This area deals with personnel , mate rial, facilities , and fund s . In re- 
cent years, industrial organizations which have similar problems in these 
areas have developed a number of new management techniques. The UCIS 
goal is to apply these new ideas to the similar problems of educational insti- 
tutions. There are two general types of operation in financial administration: 
accounting and control- 

Accounting operations have definite deadlines and widespread external 
demand, and deal with dollars and budgets. Functions which have accounting 
as a primary concern are student accounting, payrolls personnel management, 
income accounting, and general accounting. The concept of UCIS is to establish 
a single master account record in electronic form that is used to serve all 
departinents of the institution. This master record would consolidate all 
accounts, including budgetary and cost control accounts. 

Control operations primarily have internal demand. Control deals with 
units and rate¥^ Functions which have control as a primary concern are pur- 
chasing and material management, plant and equipment management, and 
investment management. The concept of UCIS is to establish control records 
wherever the master student and master account records prove incapable of 
supplying the needed information. For example, inventory control information 
should be in item number sequence, while the inventory account record should 
be in a sequence relating to department and fund numbers. 

As physical plants expand to meet enrollment increases, new types of 
facilities are developed to serve new needs. As financing gets more compli- 
cated, the administrator increasingly will need to use better control techniques 
in the area of financial administration, 

3 . Planning and Development 

The newest of the three UCIS areas, planning and development, deals 
with studying the institution's problems, planning for the future, and developing 
ways to finance the plans. These functions are becoming the most critical in 
all of admrnistration. The degree to which they are interrelated and built upon 
the two operating areas, student records and financial administration, will 
determine the effectiveness of this area- 

Institutional studies or research have become vital to the determination 
of costs of instruction, allocation of faculty effort, allocation of space and other 
resources, estimation of enrollments, and other facts about the institution's 
past, present, and likely future. For state- s upported institutions the growth 
of the planning and development area was initiated by legislative requests. 
However, mounting operating and construction costs, longer material and 
building lead times, and expanding sources of funds make it apparent that all 
universities and colleges need an effective planning and development activity 
for their own internal control. 

Planning involves projecting the resource needs of the institution into the 
near and intermediate future. The short-range plans will shape and justify the 
next budgec. The intermediate plans may affect the entire nature of the insti- 
tution. Such basic and important activity must be directed with the aid of the 
best possible information; this means not only the collection and display of a 
® le array of facts, but also the analysis of these facts as they relate to the 
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future Perhaps one of the most powerful single uses of the computer is its 

IbUUy to simulate human situations and predict the future. Stmulat.on means 
aoiiity Lu orn ryf T-Hrmt? alternative courses of action 

the abilitv to approximate the effects o+ various aiternativ i ■ j 

luhout the cos^/of actually taking any of these actions. It ^ = » ^ 

aircraft and missile design for years. It is now recetying widespread interest 
in industry and has great potential for education. 

Development of funds is an activity that must be 
oerso nal efforts o f the chief executive. It is becoming more important to 
Lgment the chief executive's skill and intuition with more ® 

of the needs for funds. This function is that of translating the adopted plans 
and their costs into income sources. As the income sources prove to be 
greater or lesser than estimated and as the nature of the educational 
environment changes, plans may need to be changed. 

4. Central to the above three is a modern data processing installation 
which is used for processing all the information. The electronic data proces 
Tug system has pLhaps, its -greatest payoff in the planning and deyelopment 
area It offers two major capabilities: (1) the ability to process lyge bodies 

ol information, and (2) the ability logically to analyse this information as an 
extension of man*s thinking processes. 

The University and College Information System brings 
contact with all pertinent activities of the on-going enterprise as these activitie 
occur. The officer gets a picture of the exceptional situation that needs his 
immediate attention.^ He can ask for rearrangements of the 

and get them promptly. He can expect new kinds of infornr^tion brought about 
by newly interrelated records from all over the campus. He ^ 

laboratory for experimentation before committing himself to costly programs. 

Let me make a few general data processing comments, and then see how 
they affect the UCIS concept and ultimately people in institutional research. 

1. Raw data in file folders in file cabinets is essentially useless for 
research purposed. 

If data is to be used only once, don*t bother to put it into a 
suitable for machine processing. However, who can prejudge a a 
this way? Thus, only the exceptional data will not be changed for 

machine processing. 

For simple efficiency, data to be used more than once should be put 
in a form for machine processing as early as possible, eliminating 
the duplication of clerical effort. 

Suitable forms for machine processing mean that information is re- 
corded on IBM cards for punching or machine reading. Wherever 
possible, a document should be used for machine re-enyy. As an 
example, type readers are in the laboratories today and will be 
practical in the not-too-distant future for some applications. 

Let me distinguish between clerical and management data processing 
application by using as an example, listings versus analytical reports. 

The number one function of an educational ins titution is to educate 
students and faculty. More effort and attention should be directed 
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toward education and the Improvement of the educational process. 

The use of data processing can assist in these efforts. With the 
foregoing in mind^ let me repeat the concept of UCIS showing how 
each section ties into institutional research- 

Student Personnel Administration 

Each student is a complete person; therefore., his record should be a 
complete record because many departments or activities will contribute infor- 
mation to build up his cumulative student record. Likewise, many dep 3i rtments 
will wish to have access to this record for whatever part they play in assisting 
the student during his academic career- Some- -the academic advisor, for 
example- -will want information about just one student. Others will want infor- 
mation for many students for management analysis. This type of information 
has usually been very sketchy and difficult to obtain. 

Now is the time for the student personnel administration to take a com- 
pletely new look at the information handling which has to be done. It should be 
analyzed as one system in the light of the complete job \/hich should be done, 
utilizing modern data processing technology with all its capabilities. 

Secondary school officials are now talking quite seriously about stand- 
ardizing student records. Statewide education systems of junior colleges, 
state colleges, and universities are seeing the need for and are developing 
standardized information as students transfer from one institution to another. 
The interest of national education agencies in consistent student data for 
planning purposes is another reason why more and more educators are looking 
at the processing of student records from a total system’s basis. 

A student’s master record should be started in the admissions office. 

The information should be put in punched card form at the earliest possible 
moment. The IBM data processing installation, even at this early time, can 
perform many valuable functions, such as editing and call ing attention to and 
even writing a form letter for missing items needed to complete an application. 

The information on applicants usually comes during a short time each 
year causing high peakloads of clerical-type work. Data processing equipment 
can help reduce time lags during such peak periods. 

It is estimated that some 50 per cent to 90 per cent of the applications, 
according to a set of rules, will be either clearly accepted or declined. 

Machines can do this kind of preliminary screening, saving the difficult cases 
for personal attention. Lists of acceptances and rejections can be printed 
with the reasons for the action taken so that personnel can. make a quick proof 
check before official action is taken. 

At the same time that individual applications are processed, the IBM 
EDP system can produce daily or weekly statistics on applications which can 
be compared against objectives to guide official action. For example, officials 
may have specific objectives for the geographic spread of out-of-state or 
foreign students, alumni vs. non-alumni relations, particular colleges or 
curriculum enrollment maxima, per cent of men or women students, availa- 
bility of scholarships or Ipans, dormitory space, academic standing, and many 
other items. Quick itiformation about any or all of these will be of considerable 
aid to officials making the decisions for admissions. Such information is a 
O 
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relatively simple machine by-product of the application process if the entire 
application is put into the data processing system from the very eginning. 

Quite a few schools are doing extensive analysis of applicant information. 
They are able to give relative values to the same apparent grade rom 

JiiLrSat ichlL based oa past pejformaace of the studeats. From this and 
ofer Wormatioo they are thee able to make fairly accurate predictions on 
first-year academic performance of students. 

Once an applicant is accepted, the IBM UCIS can automatically start him 
on the next steps toward class registration start the for 

financial area including fees, loans and s cholar snips , s ill without 

other services, such as board and room, medical and testing --all without 
people having to duplicate information already in machine form. 

Many colleges already use IBM computers to do the actual student 
scheduling function. Procedures being improved to make f 

such an operation as efficient as possible with respect to costs, facilities, and 

faculty requirements. 

Testing and counseling are important functions before and after admission 
to college level work, and a thorough analysis of a test is an easy task the 

IBM system. The testing process should mean far ^ 

rieht or wrong answers. The results can provide a great deal of information 
about student performance, the value of te st questions and the 

the teaching process. This kind of information can be used to f 

ual student improve himself. It can help the institution improve its educational 

function. 

As testing and analysis procedures are improved through the use of ciata 
processing procedure,*?, counseling procedures can become more effective in 
guiding a student toward his educational objectives. 

During the school year the IBM UCIS can greatly reduce the clerical work 
in connection with grade reporting, and from that task, 

It can uatomatically produce honor lists and call for assistance to help those m 
academic difficulty. Editing can also check on individual progress toward 
degree requirements, as early as the first day of classes, so a p u4f.u 

embarrassment caused when an error is.found to late to allow a change 
would permit graduation as expected. 

When the question of job placement comes up before graduation, good 
recordTand counseling are important. The IBM UCIS can 
records to assist the counselor. Also, the system can 
to match interests of employers and thus keep each person in c 
most suitable job opportunities. 

After a student graduates, it is important to keep in touch with him as an 
alumnus. From a long-range research basis, the correlation of school record 
and later performance can help the institution evaluate and improve its educa- 
tion and counseling operations. The institution may provide employment 
service in later years, too, thus continuing its service to alumni. 

Many schools are counting more and more heavily on alumni for both 
financial and influential support. Complete current alumni records in the I 
UCIS can qqickly provide lists in a variety of sequences, do gift analysis, and 
help in manjy aspects of communication with alumni. 
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Financial Administration 

The area of financial administration is composed of functions dealing 
with personnel, facilities, material, and funds. These functions, more than 
others associated with education, closely resemble functions in commercial 
enterprise and can benefit from the management tools and concepts developed 
and already proven useful in industry. 

Performance budgeting, internal operation costs, rates of use or rates 
of change are the kinds of information which are useful for control purposes. 
Ideally, control information would be available at any instant. Practically, a 
compromise has to be reached so that the information does not cost more to 
get than it is worth. Indeed, it should cost appreciably less than the value 
placed on it by management. 

The demands of the financial administration can be met through the use 
of the IBM UCIS and its ability to accept, store, process, and display infor- 
mation in almost any conceivable combination of ways. However, the demands 
can be met only if the entire operation is planned as a complete coordinated 
system, rather than as a collection of somewhat related functions. A few of 
the typical sub- systems applications in the financial area are given in the 
following paragraphs. 

The use of a good manpower skills inventory sys tem can give management 
a quick source of names of people who might fit any specific personnel assign- 
ment. The ability of the IBM equipment to match job and personnel profiles 
can produce quick action and allow better personnel operations, thus improving 
morale. Since the payroll is probably the largest single expense item for the 
institution, good personnel operations through effective information procedures 
can be of considerable assistance in smooth operation of all facets of the 
institution. 

A purchasing opea^ation with highly coordinated information about inven- 
tory levels, minimum economic ordering quantities, accounts payable, receipts 
and check writing can save money in material costs, inventory space, and 
outside good will. All of the above operations can be a fast, highly automated 
procedure. The analyses of vendor operations, inventories, and budget 
expenditure relationships are additional benefits ava.ilable from a well-planned 
administrative system. 

The maintenance of plant and, equipment for an institution is probably the 
largest non-academic department of most educational institutions. Good con- 
trol of costs and job schedules is greatly facilitated through the use of infor- 
mation available as part of the IBM UCIS. Preventive maintenance is facilita- 
ted by the system, but even emergency repairs can be expedited by the 
availability of fast, accurate information. This may be through simple 
reference information, or extensive information retrieval of engineering 
drawings, plans, and charts by machine procedures. 

The control of one-time projects can be greatly facilitated by the use of 
PERT and its critical path method operations. Here again the IBM equipment 
and programs can provide much information in a minimum time and thus 
expedite modern management control. 

Routine scheduling ox all equipment and facilities can be assisted through 
use of the IBM installation. Multiple input devices linked to the data 
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processing center through communication lines can keep central files up to 
date and prevent idle periods due to lack of current status information. 

The funding of most educational institutions is now being done through a 
complicated and diverse combination of sources. The need for coordinating 
all contacts with these many sources requires more and more data handling 
and analysis which can be expedited through the use of the IBM installation- 
Adequate information can influence legislators or boards of trustees to see 
more clearly needs or benefits of a program. Inves^ent analys^ eg n be per- 
formed through the use of computer programs already available . Alumn i 
drives can be organized for more efficient coverage and return through the use 
of well-mechanized record handling. Re search contracts require e ai e 

accounting and record keeping which can be facilitated through the use o^ 

IBM UCIS. The foregoing comments are only an indication of the many rea 
why the financial administration needs a we.ll thought out information handling 
system and capable equipment in order to do its part in helping the e uca i n 
institution meet its objectives. 



Planni ng and Developrn*:?nt Administration 

Of the three general categories of administrative work described in the 
IBM UCIS, the pl anning and development area is the one most closely re ate 
to the chief administrator of a college or university. The use of data proce 
ing equipment can save some money and time in student and financial record- 
keeping applications, but it has the potential for making by far the greatest 
contribution in the planning area. 



It is rather strange that computers have found extensive use in scientific 
areas but that there has been almost no transfer of this knowledge and capabi i y 
to the area of administrative planning on the same campus. 



Too often, planning is a "made do" effort, handicapped by a lack of time, 
clerical effort, and information. Decisions are made on assumptions, esti- 
mates, and small samples which are often not very respresentative. 

When the student and financial records are mechanized, all this infor- 
mation is easily available as an inexpensive by-produce for use as input to the 
planning operations. The kinds of reports generally desired are not simple 
lists from the past, but rather analyses showing trends, shifts, changes, 
utilization of facilities, etc. With the aid of this type of information, 
projections can be made as to what the most likely possibilities will be in the 

future. 



A whole new technique is now available to assist the administrator. It 
is called simulation. It depends on mathematics and may be greatly aided by 
the use of a computer. Dr. Hendrix will have more to say about this, so my 
remarks will be very sketchy. 

Scientists and engineers have used simulation techniques for years. 
Sometimes this takes the form of physical models, such as scale models of an 
airplane in a wind tunnel. At other times the simulation is completely mathe- 
matical in the form of equations. An example of the latter is a s^ple account 
ing procedure. This simulates the flow of actual cash through a business but 
does it in terms of numbers, rather than, the actual bills or coins. 

Statistics from the past can give values and illustrate trends for such 
ERJc things as number of applicants, numbergi^students, drop-out ratio, academic 
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fields of interest, academic abilities, class sizes, faculty- student ratio, in-out 
of state student ratio, men-women ratio, cost per student per subject and level, 
area per subject per class, material costs, and many other relationships. 

If the administration assumes the trends will continue, it is relatively 
simple to give quantitative values, for any desired time in the future, to such 
questions as; how many students, teachers, dormitory spaces, and classrooms 
are needed? What cost per student per course, what total costs, what 
operating costs in a wide variety of categories, etc. ? 

Most administrations cannot assume that the future will confine the same 
as the past. They have to make assumptions that some rates will increase, 
others will decrease. They have to assume certain ceilings will exist at 
various times in such things as space, facilities, and finances. With a com- 
puter they can make the calculations to show the consequences of various 
decisions. The administration can virtually experiment with ail aspects of 
operation which can be put into numeiic form. Hundreds of combinations of 
factors may be examined to determine their effects without committing or 
risking any large outlays of money. 

The IBM UCIS offers to the administration valuable information from 
which it can make well-informed decisions. Once a decision has been made, 
statistics should be available to keep a close check on the relation of the 
actual results and the expected results so that action may be taken quickly 
when anything deviates from the plan. 

With the growth and changes in education coming as fast as they are, 
planning must be done better, quicker, and farther into the future than ever 
before. The IBM UCIS will pro'-' tV>e facility to do this. Machines will allow 
personal attention - 

You people in instituliv search should support the Improved system 

concept of mechanizing student and financial record handling with modern data 
processing technology- -high volume processing and output capabilities. This 
will provide you with both the information, you need for your own work and the 
processing capability to do the research. 
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Introduction 

The primary purpose of this document is to present a rationale for re- 
search, atoinietrative ia aature, which permits aaalyses - 

proposed activities of the various compoueuts of a system, 

Will then permit the ideutification of decistou situations and of bolutions to these 
lecisions which will maximise the over-all effectiveness of *= educat.^^^^^ 
system. The term "educational system" means any suffic en y univer- 

aL discrete educational institution, organization, or unit. It could be a ^ 
sity, a college, a junior college, a school district, a state school system, o 
an individual high school. The phrase "administrative research is used to 
refer to the over-all process involved. More specifically, it means basic 
concepts and rationale behind the processes. 

It will be apparent that these concepts have been borrowed from opera- 
tions research as it has developed in business, industry, and the military bu 

have beeu altered aud adjusted so that they are applicable ‘Ym“avoid“foufu‘sTon 
prises. Thus, the phrase "admiuistrative research" ts used to avoid confustou 

with operations research- 
Definition 

Administrative research is broader in concept than what 
institutional research and may actually utilize institutional research (making 
studies, gathering data, etc- ) as a basis for arriving at decisions. 

Administrative research is a process which involves the continuing use 
of a particular conceptual framework as a basis for arriving at 

This framework consists of the application of scientific methods to the process 
of defining objectives, assembling relevant data, and utilizing t ese .n arriving 
at decisions which affect the achievement of the objectives. 

Characteristics 

Before proceeding with a formal presentation of the concept of adminis- 
trative research, one must list some of the characteristics of administrative 
research. These can be either essential or nonessential. The essent a 
characteristics are as follows: 

Administrative research is concerned with the systems approach. It 
seeks to find the best decision for the total institution or opera ion. 
This may involve an increased achievement of som.e objectives and- - 
upon occasion, in the interests of the total institution- -a decreased 
achievement of others* 

Administrative research is interdisciplinary in nature and lends 
itself to a team approach. A team may consist entirely of staff 
members from within an institution (particularly in a college, the 
faculty of which includes rep^fs^enta fives of varied disciplines), 
entirely of experts from outside the institution, or of members from 
both within and without the institution. This organization permits, 
even encourages, the paggipation of faculty members from a wide 
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number of disciplinary areas to become involved in studies of their 
own institution, bringing to bear their own particular specialties on 
the institution's problems. 

3. Administrative research aims to bring the most advanced available 
procedures to bear on the process of arriving at effective decisions. 

It aims to provide decision-makers with a scientific basis for arriving 
at decisions which involve the interaction of components of the insti- 
tution in the best interests of the institution as a whole. Usually, 
models are devised to illustrate the interaction of factors affecting 
the achievementcof objectives and the objectives themselves. 

4. Any or all types of research (theoretical or applied, experimental or 
survey, literary or statistical) may be used to provide relevant data 
for the administrative research process. 

Some nonessentiall characteristics might be: 

1. Administrative research is, if it is being used at all, a continuous, 
as opposed to discontinuous or discrete, process. It involves the 
repeated and continuing examination of relevant facts during the 
process of study, and, hence, the frequent revision of objectives, 
methods of study, and procedures for applying results to the making 
of decisions. It is not a problem-solving device or a technique with 
which to meet emergencies or "put out fires, " although it would 
probably assist with such administrative tasks. Accordingly, the 
processes in administrative research cannot ordinarily be listed in 
sequence. 

2. The basic tasks in administrative research are, in general terms, 
translating the problems of the decision-maker (in institution-wide 
terms) into research problems, assembling relevant data, and 
applying the findings to decisions. 

3. Administrative research provides decision-makers with informat- 
by which they may assess the extent to which the many di 
objectives of the institution and its parts are achieved, anu i^ow the 
relative achievement of these objectives relate to the effectiveness 
of the institution as a whole. Effectiveness is ultimately deterixiined 
on the basis of the relative value of the objectives and the extent to 
which they are achieved. 



As sumptions 

Several assumptions are necessary if administrative research is to be 
useful in educational systems. Some of these are as follows: 




1. Only people have problems; problems do not exist unless there are 
people to be aware of them. In general, problems exist when some- 
one wants something that he does not have, or feels that what he has 
is somehow lacking. When someone feels that he has a problem, 
and he is also required to find or develop a solution for the problem 
(i. e. , he must find the "something else" or alleviate the "lacking"), 
he is usually called an administrator or decision-maker. 

Another assumption which appears to be inherent in administrative 
research is that pure, theory,-roriented research and split-second 
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decision-making can be regarded as lying at opposite ends ^ 
continuum. At points in between these extremes would lie such 
processes and procedure s as institutional research, surveys, 
gathering of data for administrative use. and such behaviors as 
checking to see if a student whose last name is the same as e 
govenor of the state is actually the governor’s relative be ore 
signing forms to have the student dismissed from the state univer- 
sity for dormitory rowdiness. 

Much of the literature and research in the area of decision-making 
administrative behavior. Typically, administrators are ^ ^ 

situations, problems, or questions which need ^ 

ess. as studied, consists of the selection of alternatives based on knowledge 
already held or readily obtainable about the situation. In some treatments of 

the decision-making behavior ^^mmistrators this proc^ 

Quite otteu the 

organization, system, and the environment of the in.stitution 
ignored. The simultaneous consideration of the total environme ’ 
its objectives, problems, and possible solutions, is seldom ^ 

fact, looking at the problem in this behavioristic manner one finds it extremely 

difficult to view the total system. 

the other end of this continuum, we might f:.ad the traditional classical 
view of research. This concept views research as originating from contri- 
buting to, helping to alter and/or to reorganize theories, which, stated in 
general terms, attempt to explain for man his perception of his ^ 

Liverse. For example, in relation to educational matters, researchers have 
developed and are constantly testing certain theories which ®^P 

learning. A typical attitude expressed by administrators regar 
as useful and necessary, but not too -practical" for making decisions. 
Complexity> tentativeness of results, and other excuses are o en use 

It is felt that administrafrive research might be able to coordinate and 
organize the processes and procedures that stretch over this continuum so 
that the administrator and policy-makers can make more exP ■ t use of the 
entire range of research activities for decision-making. 

3. In the first assumption it was stated that only people have problems, 
similarly, it may be assumed that objectives, and the relative 
values of objectives, do not exist unless there are people to value 
them. This assumption is indeed basic to all educational en erprises 
and prohibits administrative research from being mechanistic or 
dehumanizing. In fact decisions reached without this type of analysis 
are probably more mechanistic, since they can't take into consider- 
ation all the relevant values and elements in a situation. 

4. Another assumption is that objectives must be stated in measurable 
terms. This is again basic to all educational endeavors, but usually 
does not characterize the objectives of the institutions as a whole- 
Any catalog statement of institutional objectives bears mute evidence 
to this fact, since in nearly all cases they are not measurable, and 
in most cases are meaningless. 
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Elmer West, speaking at the Forum on Institutional Research at the 
convention of the American Association of Junior Colleges, recognized thi 
problem. He states, referring particularly to junior colleges: 

**Lets start with the *why?^ of the institution itself. This is not 
necessarily a problem for institutional research, but it is pre- 
lixninary to institutional research and is a problem for adminis- 
trative research- Unless the situation has clearly stated objec- 
tives, it has no way of determining its progress tov/ard those 
objectives. Furthermore, those objectives must be stated with 
clarity and conciseness, and with a reasonable relationship to 
potential accomplishment, if they are to be researchable. A 
community college cannot, for example, give as its purpose 
* service to the community* without delimiting its service so as 
to exclude fire and protection, street repair, transportation, and 
othe r s e rvice s to the community . The situation may res emble 
that of the man who had learned numbers, but not how to read, 
when he came to the sign post he could tell how far away he was, 
but not what he Was^ away from- The first step, then, is to ask 
*why* and see that an answer is given in reasonable, objective 
terms. Although this should precede institutional research as a 
practical matter, it may, in some instances, be the first task of 
institutional research. 

**Activity and achievement are not synonymous; the latter P^e- 
supposes some point of departure and an objective. In the junior 
college field objectives may not be less clearly stated or more 
confused than in other components of higher education, but they 
may appear to be because of the focus of attention on them today. 
For this reason, there is perhaps even greater need to emphasize 
the necessity for clear objectives as a basis for goal-directed 
institutional research in the junior college. 

*'Once the aims are clearly established, the programs--offered 
or needed — to accomplish the objectives may then be studied. 
Education in this country seems to pride itself on its diversity. 

But neither conformity nor diversity has virtures within itself, 
and neither is, therefore, of value in itself. These, also, must 
be related to the purposes of the institution if they are to have 
meaning; thus, the characteristics of the institution as it is must 
be studied in relation to its stated purposes in order to relate its 
effectiveness to its aims. How can the administration tell, for 
example, anything about its needs for faculty unless it knows 
what the institution plans to offer in the way of curricula and how 
these curricula relate to institutional purposes? How does it 
know about faculty qualifications unless it has studied them; and 
how are change s in the s e known unle s s they have be en the s ub je ct 
of continuous study? An institution may, quite without design, 
relate its purposes to the qualifications of its current (and 
possibly powerful) faculty rather than the other way around. It 
is difficult to understand how complacency can exist in an educa- 
tion institution, but sometimes it does because the institution 
does not exaimine itself as carefully as it examines even its 
lowliest applicant- ** 
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In a later comment, concerning objectives and programs for achieving 
them, West says: 

-Within the bounds of objective study and an ^xpe ctation of ration^^^ 
analysis and application, institutional research can ma e 

tial contributions in the area of policy making, o ong „yactice 
ning, of evaluation, and of management. It becomes, in practice, 
the systematic, continuous, organized, purposeful, evaluative 
stud-r of the institution itself. " 

Processes of Administrative Research^ 

Administrative research consists of two major = f 

can be broken down into several 'subprocesses. (See outline. ) The first con 
sists of analysis of the decision situation. The components oi 

tion consist of the (1) decision-makers, (2) the a J ^ (4) 

environment in which decisions are made °peraUons carr^ 

the factors and alternatives which are available. It is therefore clear, a 

l^Le^br-^ple administrative research techniques, that a dects ton ts seldom. 

If ever, Ihe simple matter of selecting or not selecting a course of action. 

Indeed, this would be an oversimplification of the entire proce u . , 

The second major process consists of the definition of function 
construction of models to represent the in ractions of °bjectives and ^ 
factors affecting them. The models are t. 1 solved to yield the highest over 
all effectiveness for the system as a whole. Again, this process can be 
further subdivided. 

These processes are not discrete, nor are they necessarily sequential 
or chronological. For example, in analyzing the decision situation the con- 
structTon mLels will most likely be considered. Also, the types of studies 

available in the process of defining functions and ^ Jltablish- 

in some ways determine the analysis of the decision situation and the e^tabUs 

merit of controls ovor tho functions and solution. Solving of mode s ^ u 
considered while constructing models to be sure that solution -- i a e 

for models being developed. While analyzing the decision ^ ^ , 
administrator would most certainly consider putting solutions to work ^od 
c^trolling them. He would want to be certain that the solutions were possible 

and legal] 0tc» 

other examples might be given to illustrate the 
sequential nature of these processes. Any attempt to initiate administrative 
r:"h"\n an organization would begin with analysis of the decision situation, 
but almost immediately the other processes would become involved. 

Analysis of the Components of the Decisi on Situation 

Administrative problems and resulting decision situations involve 
effectiveness of the organization as a whole and conflicts of the in eres an 
effectiveness of functional units within the organization. For example, privat 
lolirges hale mitiple goals. Oversimplilyiag, two of these might be to meet 
the nieds of the stuLnts aod meet the needs of the constituents. Often these 
conflict What balance between the two would maximize the over-all effective 

Illfof the college ? Within organisations conflicts °f 'r/h^'d 

tiveness also arise. For example, it is the purpose of teachers to teach and 
counselors to counsel and guid,^ •students. How might time, energy, funds, etc. , 
be allocated so that the student is maxim^l^ benefited? 
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After identifying a problem or issue faced by a decision-maker, one must 
translate the situation into a research problem which can be studied by scien- 
tific methods. This particular task is centrally important to the whole process 
of administrative research, for, in a sense, it epitomizes the total concept, 
requiring as it does the formulation of objectives and procedures and the 
projection of possible outcomes. 

To understand this process one must first define the system or environ- 
ment. The system or environment consists of the participant, those who are 
affected by the courses of action, those for whom the objectives are specified, 
and the decision-makers. It is often useful to think of this in terms of a 
communication network . In a given educational system this might consist of 
constituents, board members, administrators, faculty members, students, 
employers, etc. 

Analysis of the decision situation would actually depend on thorough 
analysis of the communications and control network of the organization. Such 
analysis would be needed to identify the components of the problem, to permit 
the construction and solution of models, and to administer the testing of models 
and the solution. Initially, this requires three general types of knowledge 
about the communications network. First, the status of the network at the 
present time must be established. Second, the control processes within the 
network must be analyzed, generally as belonging to one of five categories. 
Third, changes in the. .network and control processes over a period of time 
must be identified. One must identify the units or individuals within the 
organization, specify the processes they perform, and indicate the direction 
of input and output in relation to the other units and individuals in the organi- 
zation. There are a variety of sbciometric and psychometric methods as 
well as less sophisticated techniques for the analysis of communications sys- 
tems. It must be remembered that the term "comminications system" does 
not refer only to the flow of information. 

There are a variety of ootiirol pr^^csses which can be schematically and 
mathematically represented for purposes of analysis. In general they mav be 
classified into five categories. 

Transform ation processes receive input and produce output. These ™cy 
vary from simple conduction or transmission to various transformations f ne 
input before it b?="Comes output. A clerk opening mail would be representative 
of this process- 

Sorting processes or systems are characterized by at least two output 
channels. Input from one ox more sources is sorted, recognized, analyzed, 
and discharged into the two or more output chanrxels. A clerk sorting mail 
would be representative of this process. 

First order feedback mechanisms compare output to input or pre- 
established standards, Basically, such processes operate to maintain gosis 
that have been established. The incumbering of accounts, as the result uf 
orders placed, would be representative of first order feedback. The purpose 
of this process, of course, would be to prevent orders from exceeding 
budgetary limitations. 

Memory units within systems or networks permit second order feedback 
and goal- changing behavior. The previous example might be expanded to 
O illustrate this process. If orders are received which would exceed the baifance 
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available within budgetary categories, first order ^rord^r^feecj^ck 

rejection of the order. If memory units are available, 

would then examine the memory to see if past ejyenence in i 

within the given budgetary category are soon to be to 

indicated, second order feedback might permit the processing of the order 

continue. An example might be overdrawn bank accounts. 

Reflection permits third order feedback, another type of goal-changing 
behavIH?.- in"iHditiou this permits the restructuring 

current inputs to produce and to recognize new alternatives, , J’ 

this would be called consciousness. Pursuing the previous ^^^^P ’ ^ • 

processes might decide that the order in question sho^uld reaily 
Lother budgetary category, that budget funds might be transferred from one 
category 'to another, that the order might be delayed, etc. 

It now becomes necessary to identify decision-makers. Several q'^alities 
identifv , decision-makers. They are usually responsible for recommending an^^ 
modifying policies. Thmr approval is required and is expressed before policies 

Tan be^nolified, executed, or implemented. They must usually grant W 

approval and often posses veto powers. The> are responsi nization 

of Ltions taken. There may be many decision-makers 

but for purposes of considering over-all effectiveness, it is conceptually per 
mi^ssible to think in terms of only one decision-maker. It is often convenient 
to think of this person as a board of control, president, etc. Forrnal 
organizational charts are usually of little or no help in identifying decision- 
makers. 

The identification of decision-makers is important, since they are the 
ones with problems and objectives which can be valued and which must be 
obte .ned o^ maintained. Operationally, they define the objectives, 
for measuring the achievement of objectives, and specify the measur 
the efficiency and effectiveness of alternatives when applied to objectives. 
Similarly, they operationally define the alternatives or courses of action. 

The objectives, in their raw form, must be refined, edited, and steted 
in measurable form. Objectives which must be achieved in order for other 
objectives to be achieved can be eliminated since they are 
final objectives. Objectives which cannot be obtained, maintaine I, 
by available alternatives must be eliminated. Analysis 

many objectives, although stated in slightly different terms by d^®ot u 
or decision-makers within the system, are actually 

combined. By these and other ways the objectives are reduced to manageable 
and realistic form. 

A measur e of over-all effectiveness must be selected so tha.t it can be 
used to evaluate the extent to which the objectives are achieved. bus me 

and industry the achievement of such diverse objectives as maximizmg profit 
increasing customer good will, and maintaining family control of 
can all be measured in terms of money. This is always a problem, but there 
are various methods available by which this can be done (3)- 

For example, in an educational institution one might have the following 
three objectives: 1. to minimize expenditures, 2 

achievement, and 3. to maximize public support for education 
possible to equate all of these objectives, for example, to dollars and 
It is not important what measure is selected, only that one measure is selected 
for all objectives so that their ^jelative value can be established. 
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Some may think that it is impossible to do this. The fact is that it is 
done all the time. Every time budget decisions are made, educational gains 
are being weighed against dollars. The public does this every time it votes 
on bond or tax issues. When administrators drop or add classes or make 
other curriculum changes, they are weighing dollars, educational gains, and 
morale values on the same scale. The problem here is not can it be done , but 
how accurately can we measure what is being done . 

The weighting of objectives is of primary importance and is related to 
the establishment of an over-all effectiveness measure. It involves the esti- 
mation of the relative value of the various objectives. It is accomplished oy 
answering such questions as these: How many dollars is a given rise in 

achievement measures worth? Is student achievement twice as important as 
public regard or of equal importance? There are sufficiently reliable and 
valid techniques for answering these questions. 

Many factors in a situation might affect the achievement of objectives. 

In general these are uncontrolled factors such as in-migration, enrollment 
increases, changes in tax values or other sources of monetary support, or 
they are alternatives (controllable factors) or courses of action which decision- 
makers can manipulate or select, such as salary schedules, curriculum, and 
class schedules. 

There must be at least two factors (alternative courses of action or 
uncr itrollable factors) in order for a problem to exist. Alternatives can be 
reg. J d as changes in the system. These might be changes in personnel, 
such as reducing, augmenting, changing the nature of training, and qualifi- 
cations. Alternatives might also consist of changes in operations, such as 
small classes, large lecture sections, team teaching programmed instruction, 
and individual study. Others might consist of changes in materials and/or 
machines which in educational jargon would be defined by such things as student 
characteristics, entrance requirements, selective admissions, and all types 
of curriculum changes and emphases. Other alternatives m.ight involve 
changes in the actual environment, such as small institutions versus large 
institutions, building design, and teaching materials and equipment. These 
alternatives would bo refined and edited in much the same way as the objectives. 

Construction and Solution of Models 



A variety of studies and processes would be required to construct and 
solve models which represented relationships among factors and objectives. 
Many of these studies would resemble chose now found in the category of re- 
search known as institutional research. Predictive and follow-up studies 
would be especially relevant, as would findings of pure research. 

The construction and solution of models involves the defining and testing 
of an efficiency function. An efficiency function would indicate the extent to 
which a given alternative or uncontrollable factor affects the achievement of a 
given objective. Therefore, for each alternative or uncontrollable factor 
there would need to be an efficiency function for each objective. 

After a set of relationships has been determined, control procedures 
must be developed and established to check on them constantly. If the relative 
importance of objectives changes, or if the efficiency function between an 
alternative and an objective changes, the decision-maker must become aware 
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and analyzing processes of any institution. 

Models are useful iu mauy Hues of eudeavor_ that 

broad types of models. 1. 

«hich ‘hey represeut f”tasru eritom'th” of systematic and 

=HSrSH=ei:est^^^^^ 

usUy r?pres°ent Lality through analogous --‘-‘f - 
on a map may be used to 

i-sS^:;e-=2^^^^ ^S^b^licSi “ 

mo'srus%“ful lor rigorous analysis^ In =“‘=h ° hr^eSion^ips 

Calculus permits the derivation of formulas to represeni 
falling body. 

Basically there are five categories of symbolic models that have gene r- 

ally been shown to be useful. The variet^y of possible J*|;’rilte 

these categories is probably infinite. The usual linear and multivariate 

statistical models are also available. 

Inventory models, in classical operations research,^ nnnt 

problems associated with finding the optimum ‘°“hination of t^e and am ^ 
of ordering or otherwise procuring certain supplies. 

mav be fixed and the quantity variable, the quantity fixed and the time var ~ , 
^r^Lth may b^variable. Numerous examples in educational 
immediately suggest themselves in this category. The 

books and all sorts of supplies are obvious examples. P be ^usefully 

student admission.^, as related to faculty procurement might J 

investigated through such techniques^ Other Processes. "Teht L appr^^^^^^ 
issue bonds, construct buildings, and install equipment, might be appropria y 

managed through such models. 

Allocation models generally relate to problems in which certain 

must b^accomplishe - d To^certain degrees with ^ 

is usually, how should the resources be allocated to the activities ^ ^ 

’ %-v, r^vrcT all effectiveness"? Other varieties of allocation model 

maximize the over-aii eiiectivenes s . fi’ nr thp 

involve the specification only of resources and not activities, or the 
specification only of activities and not resources. 

In industry the question of allocating given machines or plants to the 
production of given commodities is an example. The manipulation to ^ra 
^o?itio° systims is another variety. For e:tample .’'rb??outed to up 

of school buses, garaged at specific points in a district, cost and 

and deliver students to their schools, minimizing such things as cost ana 

ttudfnt «me enroute. Other problems P‘“Cv\"£ 

by such techniques would be the assignment of faculty i^en 

activities the allocation of various curriculr programs among schools m g 
gfog^aphi'c areas, or the allocation of rooms and facilities within J gjven 
institution to certain activities, so as to minimise such things as room usag 
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Waiting line, models in. business and industry might illustrate super- 
market check-out stands, tool supply rooms, and vehicles and passengers 
arriving at transportation terminals. In general the problem takes two forms. 
The arrival of certain units, with certain characteristics and needs, is known 
(although there is usually a random process in operation), and facilities to 
meet these needs must be determined; or the facilities are fixed and the problem 
is to determine the proper scheduling and distribution of the arriving units. 

Many elements of concern to educational institutions would appear to be 
relevantly associated with these models. Attempts to answer questions such 
as how many students and what kind of students may we expect next year, or 
five years from now, might be profitably investigated with such models. Or, 
given knowledge of the number and nature of future student bodies, how might 
we best alter facilities and faculty within the given time period to meet this 
anticipated need? 

Replacement and maintenance models in industrial and business opera- 
tions research take two general forms. One form is concerned with the 
replacement of items which are subject to sudden failure. A relevant example 
would be if a particular part of a machine has a failure pattern, how might the 
probable cost of ’’down" time be related to the cost of maintaining spare parts, 
so as to maximize the efficiency of the operation? The other form regards the 
deterioration of items. For example, the quality of products from certain 
types of machinery declines as the age of the machinery and its use increase. 
What is the optimum ti.ne to replace or repair the machinery, to maximize 
profits, while considering the cost of "down" time, the cost of rejecting 
completed goods, etc. The problem of teacher turnover, dismissals, illnesses, 
substitution, and sabbaticals might be fruitfully investigated through such 
techniques. For example, how many faculty members will leave the institution 
during the summer months ? Should these anticipated shortages be met by 
hiring surplus faculty members or by maintaining a staff of stubstitutes ? What 
is the cost of hiring additional instructors and substitutes as opposed to the 
cost of teacher overloads, crowded classes, and double sessions? 

Competitive models take two general forms. One, which might be called 
games, is involved with the identification of optimum strategies or courses of 
action, given certain rules and probable opponent or competitor actions. 

Given that the opponent has courses of action L, M, and N available to him, 
each with certain probabilities, what is the best course of action? These 
models are of immediate use in the business world, in such areas as stock 
market manipulations, insurance, advertising, market control, and politics. 
These models might be useful for an administrator trying to select the best 
courses of action to initiate in September, given that bond elections may pass 
Or fail in November with certain probabilities, that tax override elections may 
pass or fail in February with given probabilities, and that a neighboring 
district may open a new school in February or next September with given 
probabilities. 

Another category of competitive models is that of bidding models. These 
are immediately relevant to business and industrial problems involv^ed with 
submitting competitive bids to secure contracts, and to the extent that competi- 
tive companies "bid" for customer considerations. This type of model might 
be useful for educational administrators competing for faculty members, or 
for educational institutions competing with other public institutions for tax 
funds, public support, etc. 



In reality, of course, models being constructed to represent systems 
11 seldom be limited to one of the varieties discussed. Seldom are systems 
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or organizations this simple. If a large industrial 

by a model, such a model would probably draw from all ive t l i=»vi=»l 

probable that complexities in educational institutions. 

are at least of this order. For analytical purposes, related to specific tune 
periods or specific subsets of problems faced by the administrator. 
simplified models, perhaps restricted to one category, would probably be 

useful. 

Of primary concern is the criteria for selecting the com ponents ^or 

models, if the assumption is made that a given model represents a real 

'system, this assumption is only valid to the extent that the components repr - 
sLt the relevant elements of the real system. For example, if 
component of the system is not identified and included within the model, the 
validity of the model and derived solutions would be questionable. If an avail- 
able alternative is not identified or developed, an optimum solution can neve 
be certain. Similarly, if an important objective is not identifi^ed. con^sion 
will probably result. If the effect of a particular unit wUhin the system is not 
properly assessed, inaccurate results are almost certain. 

Several methods of solving models , to identify the results of the relation- 
ships among the components, are available. In business, industry, an 
military organizations, these are often quite complicated, requiring e 
services of skilled mathematicians. Due to the nature of the variables o 
concern in educational organizations, it is suspected that these relations ips 
would not be as mathematically sophisticated. Only further study, re sear c , 
and application will answer this question. 

In general there are optimum solutions which involve the effectiveness of 
a total organization, and suboptimum solutions v/hich involve the effectiveness 
of parts of the organization. In business, industry, and the military, sub- 
optimum solutions are seldom of much use. It is probably that further work 
will indicate that suboptimum solutions are of greater us efulne s s and importance 
for educational organizations. This decision (optimum or subcptimum) must 
necessarily be made when the research problem is formulated- -when the 
components are identified. 

An example might serve to illustrate further the concept of administrative 
research. We will assume that the three identified objectives and the two 
alternatives (mentioned earlier) are discrete and exhaustive. A and B, 
before, will represent the alternatives. C, D, and E will represent the 
importance of the three objectives. This assumes that a common measurement 
scale has been derived for them. As before. U. V. and W. represent the 
efficiency with which alternative B achieves the three objectives, and X, Y, and 
Z represent the efficiency with which alternative A achieves the same objectives. 
To simplify the arithmetic, the importance (C) and the efficiency unc ions ( 
and X) for the first objective (cost) will be "inverted; " That is, a 
function will represent lower cost, a lower function will represent a higher 
cost, and a higher "importance" of lower cost. S represents the effectiveness 
function for alternative A. and T represents the effectiveness function for 
alternative B. It must be remembered that this is the over-all effectivenes 
of the organization, not for any single objective or group of objectives. 

The following may then be regarded as the "concept" of operations 
research as applied to executive decisions in an organization. 
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Figure 1 
A B 

CDE X U =ST 
U V 
Z W 

The arithmetic would be as follows: 

CX + DY + EZ = S 
CU + DV + EW = T 

Having gone through this process, the decision-maker would be bound to the 
selection of alternative A if S is larger than T, or alternative B ff T is larger 
than S. This is not mechanistic and does not replace the decision-maker by 
some abstract formulas, machines, etc- Rather than base his decision on the 
rather gross dichotomy of either A or B, he made a number of small decisions 
(and hence probably more valid and reliable) when he developed C, D, E, X, 

Y, Z, U, V, and W. Naturally, this could be expanded to include as many 
objectives, alternatives, and uncontrollable factors as necessary. When the 
relationships are more complex than those implied in this example, more 
complicated ’’models" must be sought to explain the relationships. Seldom are 
the objectives and alternatives discrete. 

The final process in administrative research might generally be described 
as the leadership aspect of administration. This involves finding ways to 
implement changes in the system which appear to be desirable. In other words, 
if administrative research indicates that alternative 'B (tutorial examination 
system) should be adopted, how does one go about making the necessary changes 
in the system? 

The information gained in identifying the components of the system would, 
of course, be invaluable, especially the communications and control aspects 
of the system and the identification of the decision-maker. 

To summarize, it is suspected that administrative research, as a 
methodology, a way of looking at problems, a method of analyzing problems, 
a technique for understanding and controlling the processes of complex sys- 
tems and organizations, would be useful in educational systems and organiza- 
tions, would offer a: rationale far the combination and coordination of existing 
types, techniques, methods, and theories of research. 
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Outline of Processes of Administrative Research 



1, Analysis of the components of the decision situation 



Defining the system or environment 

1. Status of communications and control network at a given time 
Z. Control processes in communications network 

a. Transformation 

b. Sorting 



3. 



pirst- order feedback (goal maintaining) 
d. Memory (permits second-order feedback; goal changing) 



e Reflection (permits third-order feedback; goal changing, 
recombination of memory to produce and reorganize new 
alternatives; consciousness) 

Change o£ communications network and control processes over time 



B. Identifying decision-make r(s ) 



C. Identifying the objective(s) 

1. Editing objective(s) 

a. Elimination of prerequisite objective(s) (means) 

b. Elimination of objective(s) unaffected by alternatives 

c. Combination when possible, especially when same objective is 
specified by different units of organization 

Z. Defining effectiveness measure 

a. Quantitative objectives 

b. Qualitative objectives 
3. Weighting objectives 



D. Analysis of factors affecting achievement of objectives 

1. Identifying and editing alternatives (controllable factors) 
Z. Identifying uncontrollable factors 



II. 



O 
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Construction and solution of models representing interactions among 
alternatives, uncontrollable factors, and objectives 

A Defining the testing "efficiency" function for each flternative with each 

objectives, and defining relationships between uncontrolllable factors 
and alternatives 

1. Gathering of information through studies to define the test functions 

a. Experimentation- -extern^l'-internal 

b. Studies --internal 

c . Sur v6y — 6xte rnal 
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2. Establishing controls over functions 
B. Solution of model yielding effectiveness function for each alternative 

1. Iconic models 

2. Analogue models 

3. Symbolic models 

a. Inventory models 

b. Allocation models 

c. Waiting line models 

d. Replacement and maintenance models 

e. Competitive models 

4. Selecting model components 

a. Pertinence of components 

b. Combining, dividing, and eliminating components 

c. Specifying fixed, variable, random, etc. , components 

5. Solving models 

a. Analytical solutions 

b. Numerical solutions 

c. Monte Carlo solutions 

d. Optimum and sub- optimum solutions 
6- Putting solution to work 
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You may have heard of Mark Twain's remark to the effect that all that is 
needed for success is ignorance and self-confidence. 1 would not car-’ o 
detail the implications of this remark for college administration today, but I 
have a feeling that it may have been widely applicable in the more eisu y 
decades that preceded the Second World War. and even more so m the latter 
half of the nineteenth century, when the American system of higher c ucation 
began to take on its present shape- Assuming that there is ^ ° ^ 

in Twain* s assertion, we have a convenient explanation for the u 
sis upon information gathering and processing in higher ^ 

consciousness of our ignorance concerning what goes on in ° . 

has undermined confidence in dealing with the future -a fearfu future, fraught 
with financial logjams, tidal waves of students, knowledge ^ 

similar unnatural catastrophes. Indeed. I sometimes sense a feeling of near 
panic among many experienced top administrators as they look in o 
that our present-day educational Cassandras have detailed for us. It is highly^ 
logical that such a situation should generate a great demand for in orma ion 
logical step. but. as with most other logical steps, one taken on y un er 
great deal of outside pressure. 

Demand has created supply, and now we have a substantial 
information specialists. Companies such as IBM thoughtfully provide highly 
developed information-processing equipment, and lo ! a new profession is born- 
The intellectual vistas that have opened are seemingly limitless, and of pro- 
found import for the future of society. I doubt if there is anyone 
institutional research who has not at one time or another thrilled to the 
cations and potentialities of his work. But promise is not fulfillment, and the 
elation that comes from enthusiasm is often succeeded by a du^l t-ud follow ng 
the first touch of administrative reality. 

Admittedly, the administrative situation is changing rapidly. 
significantly, we see about us the rise of a "new breed of educational adm 
trStors. characterized, as so often their predecessors were not, by a hu^r 
for information and open-mindedness with regard to new ideas. But we should 
be extremely wary of assuming that objectivity and creativity on the ® 

top administration necessitate any delegation of administrative responsibil y 
to the information specialist. Difficult as it may be for professional special- 
ists to accept, the results of institutional research are destined to be used, 
and the determination of use lies in the hands of others. 

This can be intensely frustrating for an individual, particularly since his 
work is so close to a point of decision and action that it is almost ®."" 

and. I would hold, undesirable- -for him to abstract himself from consideration 
of the practical use to which his findings will be put. But his influence is at 
best indirect and incidental. Over a period of time he may find his positicM 
impossible to maintain with any degree of psychological stability. _ I suspect 
that institutional research specialists will, as a group, be themse ves s u 
in another decade or two, and found to be characterized by a hig egree o 
mobility, strong atavistic yearnings for the classroom or routine office work, 
and unusual susceptibility to offers of higher administrative positions. 

In more particular reaction to the paper presented by Dr. Hunter. I 
would have to say. with all due respect to the efforts of IBM, that ^^vanc^s 
in computer technology have not really solved the basic problems of institutional 
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research. Locked at in. a rather pes siroaistic way, you might say that Dr. 
Hunter is showing us hew to make our mistakes faster and more cheaply. In 
no way is this a criticism of the equipment as such. It is highly proper for 
technical experts to say, "Here is the equipment, this is what it can. do, go 
ahead and use it. " No assumptions need to be made about the competence of 
the person using the equipment, nor the ease with which his organization can 
assimilate the information produced. Hopefully, the existence of the proper 
tools will mean that, eventually, the job will be done. At least higher educa- 
tion is not alone in its dilemma: many businesses are running into similar 

problems in trying to accommodate themselves to the technological demands 
of the computer. 

The facts of the matter are that institutions of higher education have in 
the past got along with so little information that it may well take a long, long 
while for them properly to assimilate and act on the information that is now 
becoming available. We are attempting to irrigate deserts, but we don't want 
a flood. Even simple facts go a long way, where they represent the first 
breath of reality in the decision-making process of a particular college. In 
the larger institutions the computer already has come into its own, but the 
work that it does is basically elementary: it is simply going through those 

ten thousand folders that Lee Hull referred to earlier and counting, albeit 
with fantastic efficiency. Its chief relevance is still in terms of speed and 
quantity; beyond simple statistical manipulations of the raw data its great 
mathematical power remains unused. 

With regard to Dr. Hendrix' paper, I would like to raise an assumption 
not too often accepted or even discussed by administrative theorists. It arises 
from what I have already said, but I am proposing it here because of its 
theoretical importance for the future of simulation and model-building. It is 
this: that there is an essential discontinuity between research and decision- 

making. Dr. Hendrix seems to assume that there is not, and his argument 
follows skillfully and logically from that assumption. If information alone is 
to influence decisions, then obviously the highest-quality information that can 
be provided at any decision- point is the determining factor; and, ultimately, 
although obviously not in the near future, it should be possible to automate 
decision-making once a certain degree of sophistication in our techniques is 
achieved. 

Frankly, this gets us into trouble as institutional research specialists. 
To the extent that we try to supplant our superiors by a simulated model, I 
suspect that we will quickly lose our jobs. "1984" ic not here yet, and I doubt 
that many college administrators are anxious to hasten its a,rrival- 

More seriously, there is a substantial jump between using a model as a 
convenient means of testing hypotheses, and assuming that the results of any 
test can be translated directly into action. In a recent article in the Harvard 
Business Review (March- April, 1964), John Dearden discusses at length the 
impracticality of the latter approach for business. An a fortiori argument 
is inescapable; if this cannot be done in business, how can. it be done in 
education with its host of indefinable parameters ? 

What seems relevant to Dr, Hunter's paper seems to apply also to 
Dr. Hendrix' thesis. What we need now and for the foreseeable future are 
not highly developed models that tie research tightly into the administrative 
decision-making process, but rather as many pertinent facts as can be 
O conveniently gathered and absorbed. Charles Babbage, a nineteenth- century 
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inventory ^ho aaticipatad the 

?ac\fL?fe‘rmrrn^«Sufaad durable than those which, result iroxn unsound 
reasoning respecting true data- ” 

This indeed is my own personal conviction, and how I see the job 
ihis inaeea i=> ^ ^ e^vnected to provide relevant and 

Lccfra'jrTa^^^ acf^inistrators who ^ave to bear the 

fonSibt^^4“ 
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There may be some overlap with the previous 

Swere^rL L of interest. oL charge here today is discuss J^wj^rends of 
the far-out type. Despite this charge i cannot help but take a somewhat 
co„s“vati.7roint of view in reacting to the 

to the latter I say particularly the latter because I think I can visualize the 

SrdLS;; ^litntt^. ‘'^fha^e'dS?*^;^: "in^lt^ving 

the'^htgher institution itself as a system to be 

tive vllues and mathematical relationships, as outlined by 

My somewhat disconnected series of remarks, ase '^P^^ idealistic 
frime of reference, may, then, bring realism to the latter, idealist 

statement; they may bring us back to earth, so to speak- 

My first reaction has to do with the implementation of the ideas discussed 
in the papers. Dr. Hunter talked about this in terms of the necessity for an 
inteVation of efforts in developing the total information 

for the support of all university officers. I submit, and it is a ^ 

manv if not most of our top university officers have not passed through 
Tnd fourth stages of Professor boi's analysis of the sequential development of 
higher institutions. Thus, they are not now and 

use the advanced and complex techniques outlined in Profes P P 

On the basis of the very sound principle that 

to use information in management processes only if he ^°^P . , ' 

mation and the procedures used in deriving it. Professor Hendrix paper 

carries the implication that what we may need in is'^some^very 

matrix algebra for college presidents. . ® univer^sity 

difficult work vet to be done in integrating the efforts of the various university 

“s on mL^of our campuses, if we are to -^-elop common ground^ 
communication among the offices and the officers, so that computers may 
communicate for them across the various -fP°--bility areas. ^ 
example 1 have from my own institution, and I doubt if it is 

tSn most others in this respect, is the simple matter of department codes. 

^ach administrative office that handles institutional ^ta at 

one or more coding systems which it uses for departments. Except for our 

office most of these are designed only to arrange departments in alphab 
ol.j».>c-e, most oi L e 6 -KAaTrKp. wVi 3 t is needed in order to solve 

rro-“™ 

Lui^Le and actively promote the development of the coordination needed for 
integrated data systems. This is a justifiable role for 
Dr. Hunter very pertinently pointed out, the data that nee 
institutional research are more often than not the same 

maintained in the several other record-keeping offices of the institution. 

My second point is that Dr. Hendrix', paper, is an interesting academic 
exercise. Because I am open-minded and committed to the aims of scholar sh p, 
I hope that he continues it- 1 think he would admit that what he is doing is 
exploring a problem area, and he would not claim to have final answers to 
orLent to us. However. 1 am not as convinced as are some others that it 
will ever come to pass that the "total operations analysis technique will be 
applied to higher i^titutions- Maybe ten or twenty years from 
be far enough advanced in concepts and techniques to use some of 
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this global approach to institutional management. In the meantime, the show 
must go on. I will be back in the office tomorrow and will be expected to be 
Carrying out institutional research. 

My next point is a rather fundamental one. A major requirement of 
Professor Hendrix' system is that all factors or components in the environment 
be measurable, and even that all be measured on the same continuum. Further- 
more, primary factors or components of the system are institutional objectives. 
While my view may be limited, I cannot perceive of a common continuum for 
the measurement of, and I quote from his paper, "1. to minimize expenditures, 

2. to increase student achievement, 3. to maximize public support for educa- 
tion, " which has sufficient validity to justify its use in the complex mathe- 
matical formulation underlying his approach. I submit, as did Professor 
Cavanaugh, that the weighing of whatever modest evidence we can provide to 
university officers is an essential ingredient of management processes which 
keep the institution viable. 

More specifically relevant to the measurement requirement is the point 
that achievement tests can, I am convinced (and many others do not believe this), 
be quite relevant to certain classes of institutional objectives. They are, how- 
ever, relative measures, not absolute measures, and on this basis cannot be 
combined with other measures on any absolute scale continuum. 

The fundamental principle involved here- -and it bothers me considerably 
in my work- -is that "the best education is that education which is least meas- 
urable. " This principle has wide applicability. For example, in achievement 
tests the measurement of knowledge of facts is considerably easier than the 
measurement of creativity. In institutional cost and faculty load studies the 
measurement problem is much easier, if all instruction takes place in organ- 
ized classes with one instructor for each class than it is when team teaching, 
independent study, television, and other atypical and, perhaps, "better" 
arrangements are used. You may extend the list of illustrations of this 
principle for yourself. 

Another point is related to the fact that some of us may have concluded 
from this three-day meeting that it is somewhat futile to attempt to define 
"institutional research. " While I resist entering this arena of definition, I 
cannot resist commenting that I don't like to be subsumed by anything whether 
it be operations research or administrative research, and Professor Hendrix 
argues that institutional research is so subsumed. The proper conduct of 
institutional research has much in common with many of the ideas he discussed, 
except that we use less-sophisticated, less -integrated approaches than those 
described. For example, a basic concern for institutional objectives and the 
attainment thereof should underly any institutional study, whether it be of 
teaching methods or of teaching loads. 

In the early and major portions of Professor Hendrix' paper, he empha- 
sized the analysis of the "total system" and over-all institutional objectives. 
Later,* and thankfully to me, he talked about more restricted areas and analy^- 
ses of "subsystems" v/hich might lead to "suboptimum solutions, " if I am 
using his terminology correctly. I feel more comfortable with this latter 
approach; it strikes me as more like what I have been doing in analyses of the 
instructional program, in depth: studies of individual depardnents, in studies 
related to specific problems, and so forth. For example, he discussed 
"inventory, " "allocation, " "waiting line, " and a couple of other models which 
Q .ppeal to me on the basis of their potential utility in solving restricted problems. 
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At this point, the model or models outlined in his paper are exceedingly more 
likely to be of use in studying specific areas or in solving specific problems 
than in dealing with global problems or total institutional operations. 

professor Hendrix suggested that models in education will not be as 
sophisticated mathematically as those in business, industry, and the military. 

I submit that after the ten or twenty years are up we will find the models for 
education even more sophisticated than those in the other enterprises. ey 

may even be impossible to understand. Even if they can be formulated, as i 
mentioned earlier, the decision-makers, by not being able to understand them-- 
even with the course in matrix algebra- -won't believe them. We have e^oug^ 
difficulty explaining to them what we mean by "full-time-equivalent faculty. 

Another reason that I'm not going to go home and try out this somewhat 
grandiose approach to the development of data for decision-making is that any 
decision that is made changes the system and may even change it so drastically 
that the original analysis will be effectively invalidated. Much time, effort, 
and expense would have to go into the original analysis, and it would in all 
likelihood result in its own obsolescence. One reason for the existence of 
officers of institutional research is the fact that the registrars and buaine^ss 
officers could not adapt to the job when Professor Doi's third, fourth, and 
fifth stages in the evolution of higher institutions were reached- A related 
reason may be that these officers resisted changes because changes upset 
their record systems. I hope that institutional research people will have that 
adventurespme spirit that will enable them to welcome changes, to scrap t e 
methods and results of earlier studies, and to begin anew on the basis of the 
changes they have helped bring about. 

I like the suggestion of Professor Hendrix' paper that institutional analy- 
sis must by nature be interdisciplinary. Institutional research cannot become 
a true discipline in any traditional sense. Institutional research needs the 
help of many academic specialities in knowledgeably carrying out the diverse 
types of studies that are needed. It is significant to note that we have these 
resources on our campuses, in the form of faculty members in academic 
departments. The only problem is to convince thern that research in higher 
education- -even research on a single institution- - is a respectable area for 
work. 



If I criticize Professor Hendrix' ideas, I must suggest alternatives to 
them. Therefore, I will mention a couple of approaches to institutional re- 
search that have interested me. First, I have been intrigued with the methods 
that some people have been using to project course enrollments and the uses 
that they are making of the projections in academic management and planning. 
Maybe this is really an example of a "simulation technique. " If this is true 
then it is easier for me to think or talk about "simulation techniques' because 
I have seen an example of one. 

Another intriguing study is being carried out by Dr. John Dale Russell 
at Indiana University. He is surveying all. the^off’-es on the campus of Indiana 
University, to determine what institutional data are maintained in these offices, 
and he is developing a taxonomy and a catalogue of the types of data. This 
type of analysis will be of considerable value to the Bureau of Institutional 
Research at Indiana and would be of similar value to other institutional research 
offices in helping them go about their job. It will very effectively reveal dupli- 
cations of efforts, instances where communication is lacking, voids in types ol 
data that can or should be collected, conflicting definitions and categorizations 
FRir of data, and so forth- These types of knowledge should be invaluable in 

gg 
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attempts to increase the coordination of administrative offices, to move in the 
direction of the integrated data systems of Dr. Hunter’s paper, and even to 
develop the systematic types of measures required for the techniques suggested 
by Professor Hendrix. 

Finally, out of concern for the criticism of institutional research and 
other offices that data are often compiled, analyzed, and reported in the 
absence of a consideration for the intended uses of the data, I have thought 
about attempting to study and categorize the decisions that are made in the 
planning, management, and evaluation process of higher educational institutions. 
An analysis of the decision types and categories might produce enumerations 
and categories of data that would be needed for and relevant to the decisions, 
and thereby provide a framework within which institutional research in co- 
operation with other offices could rationally plan the types of data to be 
collected, stored, and reported and the types of special studies that are 
needed. 

In summary, let me say that, while some of my remarks may have been 
critical, and I hope they were constructive, these two papers have focused 
attention upon what I consider to be exceedingly significant problems faced by 
institutional researchers: namely, the need for that increased communication, 

cooperation, and coordination among diverse responsibility areas that will lead 
to the integration of basic record systems, the need to keep institutional 
objectives and purposes at the center of our attention in carrying out institu- 
tional studies, and the need to develop new and imaginative methods for study- 
ing and solving the variety of problems and making the variety of decisions 
faced by our institutions. 
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In contrast to the approaches of the previous 
felt the impracticability of the two new techniques of the full data system an 
r-iethodology of operation research would cause them at some time to be a 
Srfattoufin our job, I'm going to take the position ‘"at we had betmr all be 
alert at least to this threat because we may be much closer to it t 
w nw’ Tf it is 'indeed a threat, I think the advent to total information banks, 
al^rthe accaaaiMUty to them,' are certainly a near reality. They are gotng 
to be in our institutions very shortly, for better or for worse. 

I also believe that the application of operations 
decision-making and planning in higher 

awav from the ^ra in which, as A1 Cavanaugh said, the institutional or th^e 
eLcutive beha^^^^ is best defined as that by an individual who has enough 
Lteetinal fortitude to make deciaiona without any 

This is in contrast to some place on a continuum where available 

alternatives and their consequences can be better judge wi . ^ . 

immediately for the judgment. My fear is 

f^mLTs^d Is tml kTnd TfY Mechanisation 
^f “n-Malinrin whMh ful/faith and trust is placed in automamd sysm 
and in techniques in which we over- rely on their validity and reliability 
Tur sUuaMT A second possibility which frightens me - 

we create by our "new technique" approaches could 7//^ 'l^education. 

form of our present obsolete organizations and practices g 

Tn the Automation of Knowle^, a paper presented to a 
higher education in Chicago last month, Louis Munford likened the threat of 

automation in higher education to the plight of the f °''7nr^enUc^e^^have^^ ^ in 
Perhaos we in higher education, like the sorcerer's apprentice, have set 

motion the academic brooms and pails of water in ^^''n^hi^^pro?^ 
ever-increasing speeds without the old magician to stop this proces 

we drown in the melee. 

I am saying that I fear that we may be closer to this than we realize- I 

read in Science Newsletter just yesterday that a machine an 

the University College oTLondon which can, whenl presented with an ar ay 

uMwTcompLent=, Simulate itself. I have epeut some 

seen operations control systems in which computers are not only recrea g 
MTr compoueuts, but they are testing whether or not they made any mtstakes. 
Perhaps we are approaching the level of sorcerer s appren 

My response to the papers is then intended as a ca^on against the 
increasing teLency to accept automation in the place of humanism, 
enter the age of scientific management in education. 

Misinterpretation of facts is not a new phenomenon. \ ^ 
to refer to Mark Twain, as did Al, when Twain observed in his ^ife on tj^ 
Siss ssippi that scientists had discovered that the length °f th^Mississippi 
fhaimel IT s being shortened at the rate of approximately one mi e 
by the annual seasonal flood and the chai'bging of that channel. His fir t 
oLerv^Mn was that perhaps at the close °f ‘he last glacial 
Mississippi was some six or seven thousand miles g 
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the Gulf of Mexico and points south like a great fishing pole. He further 
predicted that the citizens of New Orleans and of Minneapolis, Minnesota, 
would at some future time be involved in the problems of a single 
metropolitan form of government. 

The use of budget formulas and cost formulas bothers me. At a recent 
meeting of our state budget committee it was observed by one' person, a 
heretic, that if it was going to cost some forty-five hundred dollars per year 
to educate a graduate student, we had better ask the legislature to appropriate 
forty-five hundred dollars for each of them and send them off to Harvard. 

In the creation of our master plans in tne state of Illinois, it is observed 
in statistics of demography that we in southern Illinois, one of the depressed 
areas of the USA, are faced with the unusual circumstance in 1980 of having 
a minus two hundred people of the ages eighteen to twenty- one in eight of our 
counties . 

My plea is that automated knowledge and interrelation of this knowledge 
is a critical problem for institutional researchers and the people they serve. 

I would suggest a reading by anyone in this business, or anyone related to 
higher education, of the paper by Munford. It will be in the proceedings of the 
National Conference of Higher Education . 

The real threat then is that someone is one day soon going to develop a 
computer with a human arm and internal source of power. 

Now lest this challenge be misinterpreted, let me again reiterate that 
we are in the throes of developing a total information system for our institu- 
tion with all manner of highr sounding equipment. We really believe and have 
faith, or we would not be in this business, that this can help us as can the 
operations research techniques which, up to now, have, in my opinion, not 
been completely tested in industry and military. 

We look forward to a better day in administrative behavior in our insti- 
tution. Yet we hope that we will not become overly proud of our new toys and 
our new techniques in the inquisition of fact and methodology to the point where 
we forget the inquisition of the fact or knowledge within a framework of human 
experience and time-tested values of the human personality who makes judg- 
ments. Administrative officers must retain a freedom to make judgment 
errors just occasionally, for this freedom of choice permits us to explore new 
and suboptimal paths of the maze and to anticipate the unexpected and the 
accidental forces which will come. From this choice or this freedom to make 
errors, we are going to get the bold innovations and perhaps some risky 
plunging that are so badly needed now in our present dilemma and are 
absolutely essential if we are to do our future job in higher education. We are 
grateful for the tools and the methods which can be provided to us to sharpen 
our administrative procedures, but we must insure the role of the human 
personality, with its infinite complexity, as the old sorcerer's magic to stop 
the brooms and the buckets of water we have set in motion. 
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PROGRAM 

FOURTH ANNUAL NATIONAL INSTITUTIONAL RESEARCH FORUM 



Sunday, May 17 
7:45 p. m. 



- General Session 

Presiding: John E. Swanson, Chairman 
Planning Committee 
Director of Universities Study 
The University of Michigan 



Welcoming Remarks: 

John E. Stecklein, Chairman 
Local Arrangements 
Director, Bureau of Institutional 
Research 

University of Minnesota 

Panel: A Conceptual Framework for Institutional 

Research: Three Points of View 

Samuel Baskin 

Director of Program Development and 
Research in Education 
Antioch College 

Stuart Grout 

Director of Academic Services 
Boston University 

Robert E. Hubbard 

Director of Institutional Research 

Wayne State University 



Monday, May 18 

9:00 - 9:45 p. m. 




- General Session 

The Role of Institutional Research in the 
Formulation of Policy 

Presiding; Thomas H- Shea 

Director of Office of Institutional 

Research 

State University of New York 
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Eldridge Scales 

Associate in Higher Educational 
Research 

New York Stats Department of 
Education 



Panel: 
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10:00 - 
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Vernon Hendrix 

Assistant Professor of Education 
University of California at Los Angeles 

Lois Torrence 

Director of Office of Institutional Studies 
The American University 

11:30 p. m. - Discussion Sections - (Five Sections in Five Rooms) 

¥ 

Institutional Research and the Formulation of 
Policy in Specific Areas ~~ 

Discussion sections will be held following the 
presentations on Monday morning, Monday after- 
noon, and Tuesday morning. These sections, each 
of which will be concerned with the same area at 
each meeting, will examine these areas in the light 
of the preceding presentation- Participants may 
continue with the same section each time or may 
choose different sections each time from the 
following: 

Section A - Whom Should the Institution Serve ? 

I Discussion Leader: Stanely O. Ikenberry 

Assistant to the Provost for 
Institutional Research 
West Virginia University 

Section B - Wh at Staff Does the Institution Seek to 
Attract ? 

Discussion Leader: Urban G. Fleege 

Associate Vice President for 
Institutional Research and 
Educational Planning 
DePaul University 

Section C - How Should the Institution Be Supported? 



Discussion Leader: Homer E. Still, Jr. 

Associate Director, Univer- 
sities Study 

The University of Michigan 

Section D - What Sh ould Be the Building Program 
of the Institution? 



Discussion Leader: Robert B. Smawley 

Director of Educational and 
Institutional Research 
Eastern Washington State 
S'S- College 
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Section E - Whr^t Should Be the Cu rriculum of_thg 
Institution? 



Discussion Leader; 



Galen Drewry. Director 
Institute of Higher Education 
University of Georgia 
Athens. Georgia 



1:3 0 - 2: 15 p. m. - General Session 

The Role of Institutional Research in the 
Implementation of Policy 

’ Presiding: James L. Miller, Jr. 

Associate Director for Research 
Southern Regional Education Board 

Panel: D- Gordon Tyndall 

Director of Analytical Studies 
University of California 

Carl E. Wedekind 

Director of Educational Planning 
University of Pittsburgh 

3;00 - 4;30 p- m. - Discussion Sections 

Section A 



Section B 
Section C 



Sect ion D 
Section E 



Tuesday, May 19 

9:00 - 9:45 a. m. 




- General Session 

The Role of Instituti onal Research in the Evalu ation 
of Policy 

Presiding: David V. Martin c. j • 

Coordinator of Institutional Studies 
Duke University 

Panel: Everett H. •Hopkins, Vice President for 

Planning and Institutional Studies 
Duke University 

Charles E. Howell, Director 
. feureau of University Research 
Northern Illinois University 

se 
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James R. Montgomery 
Director of Institutional Research 
University of Tennessee 

10:00 - 11:30 a. m. - Discussion Sections 



Section A 



1:30 - 2:30 p. m. 



Section B 
Section C 
Section D 
Section E 

- Business Meeting, NIRF 

Presiding: John E. Swanson 

Greetings: O. Meredith Wilson, President 
University of Minnesota 

2:30 - 3:00 p. m. - University of Minnesota West Bank Campus Planning 

Winston A- Close 

Professor and Advisory Architect 
University of Minnesota 



3:15 - 5:00 p. m. 
7:30 - 9:00 p. m. 



~ Tours of Campus and Institutional Research 
Facilities 

~ Evening Session 

Presiding: L. Joseph Lins 

Professor and Coordinator of 
Institutional Studies 
University of Wisconsin 

The Role of Institutional Research in the 
Administrative Process 

James I..' Dbi 

Director of Institutional Research and 
Professor of Higher Education 
New York University 



Wednesday, May 20 

9:00 - 1 ] :30 a. m. - General Session 



New Techniques in Institutional Research 




Presiding: 

S7 



Leroy E. Hull 

Associate Director, Bureau of 
Institutional Research 
Indiana University 
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Panel: O- Truman Hunter 

Administrator of Educational Program 
Data Processing Division 
International Business Machines 

Vernon Hendrix 

Assistant Professor of Education 
University of California at Los Angeles 

A1 Cavanaugh 

Director of Institutional Research 
University of Detroit 



Joe Saupe 

Assistant Directox’ of Institutional 
Research 

Michigan State University 
Keith Smith 

Administrative Assistant to the 
President 

Southern Illinois University 
Adjournment 



O 

ERIC 



Wesley Arden 

Director, Institutional Cost Studies 
(and Associate Project Director, 
Universities Study, The University 
of Michigan, Ann Arbor) 

Purdue University 
Lafayette, Indiana 

Clarence H. Bagley 
Coordinator, Office of Institutional 

Research 

Washington State University 
Pullman, Washington 

Curtis O. Baker 

Director of Institutional Research 
Hofstra University 
Hempstead, New York 

Robert Ballantine 
Duke University 
Durham, North Carolina 

Samuel Baskin 

Director, Program Development ar 
Research in Education 
Antioch College 
Yellow Springs, Ohio 

Robert S. Beale 

Professor of Chemistry and Directo 
of Institutional Research 
North Carolina Agricultural and 
Technical College 
Greensboro, North Carolina 

Rino Bianchi 

Administrative Assistant to the 
Vice-President 
Southern Illinois University 
Garbondale, Illinois 

Don F. Blood 

Director of Institutional Research 
Western Washington State College 
Bellingham, Washington 

Edward F. Bocko 
Assistant to the President 
Indiana State College 
Terre Haute, Indiana 



W. Robert Bokelman 

Chief, Business Administration Section 
Division of Higher Education 
U. S. Office of Education 
Washington, D. C. 

Charles W. Brim 

Research Specialist 

Bureau of University Research 

Northern Illinois University 

DeKalb, Illinois 

L- A- Brown 

Vice-President for Academic Officers 
Transylvania College 
Lexington, Kentucky 

Milton E. Carlson 

Assistant Director 

Bureau of University Research 

Northern Illinois Univexsii-y 

DeKalb, Illinois 

Robert C. Carson 
1 Coordinator of Research 
The University of Akron 
Akron, Ohio 

Ralph F. Catalanello 
Bureau of University Research 
r Northern Illinois University 
DeKalb, Illinois 

James C. Caughlan 
Director, Program Analysis 
Portland State College 
Portland, Oregon 

Alfred D. Cavanaugh 

Director of Institutional Research 

University of Detroit 

Detroit, Michigan 

J. D. Chapman 

Director, Office of Academic Planning 
University of British Columbia 
Vancouver, British Columbia 

John E- Cleek 
Research Associate 

Council on Public Higher Education 
Frankfort, Kentucky 




9S 
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Dorothy Collins 

Bureau of Institutional Research 
Indiana University 
Bloomington, Indiana 

James R. Connor 
Director, Office of Institutional 
Analysis 

University of Virginia 
Charlottesville, Virginia 

Mary Corcoran 

Associate Professor 

Bureau of Institutional Research 

Universit/ of Minnesota 

Minneapolis, Minnesota 

Edward B- Cottrell 
Director of Institutional Research 
St- Petersburg Junior College 
St. Petersburg, Florida 

Lanier Cox 
Vice-Chancellor 
The University of Texas 
Austin, Texas 

Norman C- Crawford, Jr. 

Assistant to the Provost 
University of Delaware 
Newark, Delaware 

Louis A D'Amico 
Specialist, College and University 
Business Administration, Division 
of Higher Education 
U. S. Office of Education 
Washington, D. C. 

Charles R. Dalton 
Assistant to the President 
University of Rochester 
Rochester, New York 



Hurley H. Doddy 

Associate Professor of Education 
Howard University 
Washington, D. C. 

James I. Doi 

Director, Office of Institutional 
Research 

New York University 
New York, New York 

Rev. Donald Draine 
Graduate Fellow 

Center for Study of Higher Education 
University of Michigan 
Ann Arbor, Michigan 

Galen N. Drewry 
Director 

Institute of Higher Education 
University of Georgia 
Athens, Georgia 

Theodore H. Drews 
Administrative Assistant 
Office of Institutional Research 
The University of Michigan 
Ann Arbor, Michigan 

Gerald Erickson 

Assistant Professor of Psychology 
St. Olaf College 
Northfield, Minnesota 

Merton W. Ertell 
Assistant Vice President 
State University of New York at 
Buffalo 

Buffalo, New York 

Edwards. Feder 
University of California 
Berkeley, California 



J A Davis 
Research Psychologist 
Educational Testing Service 
Princeton, New Jersey 

Murray Deutsch 
Command Control Division 
System Developmes* Corporation 
Lexington, Massachusetts 
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Urban H. Fleege 
Associate Vice President 
Institutional Research and Educational 
Planning 

DePaul University 
Chicago, Illinois 

Bernard J. Fleischman 
Institutional Studies 
Charitell’Or ' s Office 
University of California 
Los Angeles, California 
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Ralph A. Forsythe 
Associate Director 
Bureau of Educational Research 
University of Denver 
Denver, Colorado 

Randolph Foster 
Dean of the College 
Minot State College 
Minot, North Dakota 

Richard Fox 
Associate Director 
Institutional Research 
University of Colorado 
Boulder, Colorado 

G. J Froehlich 
Director 

Bureau of Institutional Research 
University of Illinois 
Urbana, Illinois 

Robert H- Glover 
Assistant Director 
Northeast Regional Office 
College Entrance Examination 
Board 

New York, New York 

Richard M- Good 
Research Associate 
Division of Institutional Research 
University of Maryland 
College Park, Maryland 

John L. Green 

Assistant Director for Fiscal 
Studies 

State Council of Higher Education 
for Virginia 
Richmond, Virginia 

Stuart Grout 

Director of Academic Services 
Boston University 
Boston, Massachusetts 

Arthur J. Hall 

Dean of Institutional Research 
California State Colleges 
Inglewood, California 
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Edwin F. Hallenbeck 
Director 

Office of Institutional Research and 
Planning 

University of Rhode Island 
Kingston, Rhode Island 

Charles W. Hardaway 
Director, Research and Testing 
Indiana State College 
Terre Haute, Indiana 

Rodney T. Hartnett 
Assistant Professor 
Office of Evaluation Services 
The University of South Florida 
Tampa, Florida 

Harold Haswell 
Director ERIC 
U. S. Office of Education 
Washington, D. C. 

Winslow Hatch 

Director, Clearing House of Studies 
on Higher Education ERIC 
U. S. Office of Education 
Washington, D. C. 

Robert Henderson 
Institutional Research Associate 
University of Hartford 
Hartford, Connecticut 

Vernon L. Hendrix 
Assistant Professor 
Department of Education 
University of California 
Los Angeles, California 

Robert E. Hewes 
Director of Institutional Studies 
Massachusetts Institute of Technology 
Cambridge, Massachusetts 

Frank Hobden 
Administrative Analyst 
Office of the Chancellor and Staff 
Specialist, Planning and Policy 
Development 
University of Califoirnia 
Los Angeles, California 





Associate Dean of Students 
University of Washington 
Seattle 77, Washington 

Evelyn E. Holtorf 
Research Analyst 
Wayne State University 
Detroit, Michigan 

Everett H. Hopkins 
Vice President for Planning and 
Institutional Studies 
Duke University 
Durham, North Carolina 

Robert E. Hubbard 
Director 

Office of Institutional Research 
Wayne State University 
Detroit, Michigan 

L. E. Hull 

Associate Director 

Bureau of Institutional Research 

Indiana University 

Bloomington, Indiana 

Truman Hunter 
Administrator, Educational 
Program 

Data Processing Division 
International Business Machines 
White Plains, New York 

Robert E. Iffert 
Research Coordinator 
Division of Higher Education 
U. S. Office of Education 
Washington, D. C. 

Stanley O. Ikenberry 
Assistant to the Provost for 
Institutional Research 
West Virginia University 
Morgantown, West Virginia 

William A. Jaracz 
Study Director 

Science Education Studies Group 
Office of Economic and Manpower 
Studies 

National Science Foundation 
Washington, D. C. 



Chancellor's Office 
University of Texas 
Austin, Texas 

Robert J Kibler 

Administrative Assistant to Vice 
President for Operations 
Southern Illinois University 
Carbondale, Illinois 

A. L. Kidd 

Director, Institutional Studies 
Florida A and M University 
Tallahassee, Florida 

A. K. King 
Vice President 
University of North Carolina 
Chapel Hill, North Carolina 

Dorothy M- Knoell 
Associate Research Psychologist 
Center for the Study of Higher Education 
University of California 
Berkeley, California 

Owen A. Knorr 
Director of Special Programs 
Western Interstate Commission for 
Higher Education 
Boulder, Colorado 

John E. Dallas 
Director 

Office of Planning and Institutional 
Research 

University of Oregon 
Eugene, Oregon 

George R. Larke 
Senior Planning Analyst 
Office of Architects, Engineers and 
Planning 

University of California 
Los Angeles, California 

Dr. T. Leaver 
Director 

Bureau of Institutional Research 
St. Joseph's College 
Philadelphia, Pennsylvania 

1C2;.: 
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Gerald S. Leis chuck 

Research Assistant 

Office of Institutional Research 

Auburn University- 

Auburn, Alabama 

Donald C. Lelong 
Institutional Research and 
Planning Officer 
Bowling Green State University- 
Bowling Green, Ohio 

R.ichard S. Lewis 

Specialist in Institutional Research 
State University of lo-wa 
Iowa City, Iowa 

Martin Lichterman 
Executive Secretary 
New England Board of Higher 
Education 

Winchester, Massachusetts 

Robert Lilienfeld 
Assistant to the Director 
Office of Institutional Research 
New York University 
New York, New York 

F. Gordon Lindsey 
Dean of Students 
Clarkson College of Technology 
Potsdam, New York 

L. Joseph Lins 
Professor and Coordinator 
Institutional Studies 
University of Wisconsin 
Madison, Wisconsin 

Lynn Mack 

Director of Institutional ReseS.rch 
Roosevelt University 
Chicago, Illinois 

Morton Malin 

Staff Associate 

National Science Foundation 

Washington, D. C. 

/ 

David! V. Martin 
Coordinator of Institutional 
Research 
Duke University 

Durham, North Carolina 10 




Thomas R. Mason 
Director 

Institutional Research and Planning 
University of Colorado 
Boulder, Colorado 

Robert E* McClintock 
Director 

Division of Institutional Research 
University of Maryland 
College Park, Maryland 

William H McFarlane 
Director 

State Council of Higher Education for 
Virginia 

Richmond, Virginia 

Robert A. McGrath 
Registrar 

Southern Illinois University 
Carbondale, Illinois 

Vernon C. Mickelson 
Director of Institute Planning 
Case Institute of Technology 
Cleveland, Ohio 

James L. Miller, Jr. 

Associate Director for Research 
Southern Regional Education Board 
Atlanta, Georgia 

James R. Montgomery 
Director of Institutional Research 
University of Tennessee 
Knoxville, Tennessee 

Cleo Moran 
Research Associate 
Wayne State University 
Detroit, Michigan 

James K. Morishima 
Consultant 

Institutional Educational Research 
University of Washington 
Seattle, Washington 

Bruce C Nelson 
■^T-ice President for Instruction 
1 .astern Michigan University 
Ypsilanti, Michigan 



Kenneth G- Nelson 
Chief, Higher Education Surveys 
Section 

U. S. Office of Education 
Washington, D. C. 

Fred L. Nicolai 
Registrar 
Temple University 
Philadelphia, Pennsylvania 

Antonio J Olaizola 
Eisenhower Fellow 

Eisenhower Exchange Fellowships, 
Inc. 

Philadelphia, Pennsylvania 
Central University of Venezuela 
Caracas, Venezuela 

Leroy A. Olson 
Assistant Professor 
Office of Evaluation Services 
Michigan State University 
East Lansing, Michigan 

Larry G- Owen 
Research Assistant 
Universities Study 
The University of Michigan 
Ann Arbor, Michigan 

Ernest G. Palola 

Director of Institutional Research 
University of Nevada 
Reno, Nevada 

John E. Phay 

Director of Institutional Research 
The University of Mississippi 
University, Mississippi 

Ira Polley 
Executive Director 
Michigan Council of State 
College Presidents 
Lansing, Michigan 

Herbert Priestley 
Chairman, ..cademic Planning 
Committee 
Knox College 
Galesburg, Illinois 



John J. Pruis 

Administrative Assistant to the 
Preside nt 

Western Michigan University 
Kalamazoo, Michigan 

Eric N. Rackham 
Executive Dean 

Educational and Student Services 
Kent State University 
Kent, Ohio 

Earl N- Ringo 

Assistant to Director, Bureau of 
Institutional Research 
University of Minnesota 
Minneapolis, Minnesota 

Lyman S. Rowell 
Dean of Administration 
University of Vermont 
Burlington, Vermont 

John Dale Russell 

Director Emeritus 

Office of Institutional Research 

New York University 

Bloomington, New York 

Herbert W. Sammons 
Command Control Division 
System Development Corporation 
Lexington, Massachusetts 

Joe L. Saupe 

Assistant Director of Institutional 
Research 

Michigan State University 
East liansing, Michigan 

Eldridge E. Scales 
Associate in Higher Educational 
Research 

New York State Department of 
Education 
Albany, New York 

S. D. Schaff 
Director 

Office of Institutional Research 
Denison University 
Granville, Ohio 



105 



E. F. Schietinger 
Research. Associate 

Southern Regional Education Board 
Atlanta, Georgia 



Homer E. Still, Jr. 
Associate Project Director 
Universities Study 
The University of Michigan 
Ann Arbor, Michigan 



Virginia L. Senders 
Staff Associate 
New England Board of Higher 
Education 

Winchester, Klas sachus etts 



Edward M- Stout 
Registrar 
DePaul University 
Chicago, Illinois 



Sally Olson Shames 

Special Assistant 

Office of Plans and Resources 

The George Washington University 

Washington, D* J. 



Sidney Suslow 
A^iministrative Analyst 
Office of the Registrar 
University of California 
Berkeley, California 



Thomas H. Shea 
Director 

Office of Institutional Research 
State University of New York 
Albany, New York 

H- M. Silvey 
Director of Research 
Bureau of Research and 
Examination Services 
State College of Iowa 
Cedar Falls, Iowa 

Robert B. Smawley 
Director 

Educational and Institutional 
Research 

Eastern Washington State 
College 

Cheney, Washington 
Keith W. Smith 

Administration Assistant to the 
Preside nt 

Southern Illinois University 
Carbondale, Illinois 

William P* Smith, Jr- 
Assistant to the Dean of Faculties 
for Planning 

The George Washington University 
Washington, D. C. 

John E. Stecklein 

Director, Bureau of Institutional 
Research 

University of Minnesota 
Minneapolis, Minnesota ^ 




John W. Sutton 
Research Associate 
Board of Control 
Tallahassee, Florida 

John E. Swanson 
Director, Universities Study 
The University of Michigan 
Ann Arbor, Michig^ti 

M- D. Tavenner 

Director of Institutional Studies and 
Research 

University of South Carolina 
Columbia, South Carolina 

Charles H- Thompson 
Dean, The Graduate School 
Howard University 
Washington, D. C. 

Wilbur A. Tincher 

Director, Institutional Research 
Auburn University 
Aubur n, Alabama 

D. G. Tyndall 
Director 

Analytical Studies 
University of California 
Berkeley, California 

Lois E. Torrence 
Director, Office of Institutional 
Studies 

The American University 
Washington, D. C, 

y . ^ 
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Philip H Tyrrell 
Director, Office of Institutional 
Research 

Rensselaer Polytechnic Institute 
Troy, New York 

Bjarne R Ullsvik 
Research Specialist 
Special Studies 
State University of Iowa 
Iowa City, Iowa 

Robert V. Walen 
Principal Planning Analyst 
Office of Vice President - Business 
University of California 
Berkeley, California 

Jess H. Walters 

Institutional Research Coordinator 
University of Hawaii 
Honolulu, Hawaii 



Robert K. White 
Adininistrative Assistant for 
Institutional Research 
University of Vermont 
Burlington, Ve rmont 

John A. Wilkinson 
Associate Dean 
Coe College 
Cedar Rapids, Iowa 

Robert Wright 
Research Associate 
Wayne State University 
Detroit, Michigan 

Martin Ziegler 

Assistant Provost and Director of 
Institutional Research 
University of Illinois 
Urbana, Illinois 



Firederick P. Watts 
Director 

University Counselling Service 
Howard University 
Washington, D, C. 

Carl E Wedekind 
Director of Educational Planning 
University of Pittsburgh 
Pittsburgh, Pennsylvania 

Roy E. Wenger 
Director 

Office of Institutional Research 
Kent State University 
Kent, Ohio 

Richard L. Wessler 
Research Associate 
Saint Louis University 
Saint Louis, Missouri 

Risdon H. Westen 
Chief, Research Division 
Evaluation Directorate 
U. S. Air Force Academy 
Air Force Academy (Colorado 
Springs) 

Colorado 

Forest L. Whan 

Q Director, Institutional Research 
ERIC Kansas State University 
Mi iwigB' i Mn Manhattan, Kansas 




